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EDITOR'S PREFACE 

It will be recalled that the National Society for the Study of Educa- 
tion one year ago published as its FourteMh Yearbook, Part I, the 1915 
report of the Committee of the Department of Superintendence of the 
National Education Association on Economy of Time in Education, 
Superintendent H. B. Wilson, chairman. It was anticipated at that 
time that the policy of this Society in publishing Yearbooks before the 
meeting at which they were to be discussed would measurably augment 
interest in the report and increase the effectiveness of its discussion. 
This anticipation was so fully realized that, now that the further report 
of the Committee on Economy of Time has been unavoidably delayed, 
it is a matter of satisfaction to be able, nevertheless, to continue our 
policy by presenting to our members, as Part I of the FifteerUh Yearbook, 
the report of another important committee, the Committee of the 
National Council of Education of the National Education Association 
on Standards and Tests of Efficiency, Professor G. D. Strayer, chairman. 

The perusal of the Table of Contents will suffice to show that this 
Yearbook maintains the high standards set by its predecessors in the 
selection of subject-matter that bears directly upon educational prob- 
lems of recognized importance and in the selection of contributors that 
guarantee a presentation worthy of careful consideration. 

G. M. W. 



INTRODUCTION 

In the pages which follow, the Committee on Standards and Tests 
of the National Council of Education presents a series of reports pre- 
pared by its own members and by others who have, upon invitation of 
the conmiittee, been willing to contribute results of their study or 
investigation. The committee feels that these reports furnish most 
satisfactory evidence of the progress which has been made in the field 
of educational measurement during the past few years. The papers 
of the several contributors may, in general, be classified as contributing 
(i) to the derivation of scales or imits of measurement, and (2) to the 
application of such imits or scales of measurement as have been derived 
in the field of educational administration or supervision. In printing, 
the papers have been grouped as indicated above. 

It seems unnecessary with this report in hand to argue in favor of 
the use of the more precise methods of measurement which have recently 
been developed. Those interested in the improvement of our schools 
have always attempted by some method or other to estimate the effi- 
ciency of individual schools or school systems. Often this measurement 
has been based upon an opinion not acceptable to another student or 
investigator, and not frequently upon attempts to measure which have 
been extremely crude. The examination system as we have commonly 
had it, not only has been responsible for judgments with respect to the 
efficiency of schools, or of school systems, but has also determined in 
very considerable measure in most school systems the progress of children. 
In the studies which are reported here, more precise measures give to the 
student of education a better basis in knowledge of conditions upon which 
to base his criticism or to develop his improved method of instruction or 
administration. The measurement of results of any sort, whether of the 
achievements in school subjects, of the cost of any imit or fimction, or 
of the rate of progress, and the like, furnishes primarily a knowledge of 
the situation which makes clear the problems involved, and which may 
suggest a method of experiment that looks toward the improvement 
desired. 

Regardless of the development which may be made in the field of 
measurement, we shall always have to deal with the problem of aim in 

9 
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education. Those who have done most to develop precision in measure- 
ment, or who have profited most by using the imits or scales, would be 
the last to deny the worth of that thinking and discussion which leads 
to a determination of the ends to be realized in our schools. When one 
has defined purposes or ends to be achieved, efficiency, in the light of 
these aims, can be determined only as we are able to measure the degree 
to which improvement or growth has taken place. Indeed, education 
may be best defined in terms of changes which are brought about in 
the individuals subjected to the process. If our aims mean anything 
to those who teach, they are or are not satisfied, in proportion as measur- 
able changes are brought about in pupils. The more precisely we are 
able to measure the development which is brought about by virtue of 
our school work, the more certain we may be that we are realizing the 
aims which we have set up, and it is only by means of some sort of 
measurement that we may even daim to have made progress in the 
accomplishment of those ends which we profess to seek. 

George Drayton Strayer, Chairman 



PART I 
EDUCATIONAL SCALES AND UNITS OF MEASUREMENT 



CHAPTER I 

A MEASURING SCALE FOR PHYSICAL GROWTH AND 

PHYSIOLOGICAL AGE 



BIRD T. BALDWIN 
Professor of Psychology and Education, Swarthmore College 



A comparative study of the results of four himdred investigations 
on over one million individuals shows that the height, weight, and limg 
capacity of children vary according to nationality, heredity, general 
social status, urban and rural conditions, geographical distribution, 
season of the year, normal and abnormal mentality, health, sex, initial 
size, and stages of physiological maturity. Among the marked modi- 
fying factors which have, to a considerable extent, made data incom- 
parable are to be foimd the manner in which measurements have been 
taken and recorded; the personal equation of trained and untrained 
examiners; the varying degrees of accuracy of measuring apparatus; the 
age of the child, as based on exact birthday, last birthday, or next 
birthday, with or without months, weeks, and days being taken into 
consideration; and the measurement of children with or without 
clothing. 

This paper aims to formulate tangible norms which may be used by 
physical directors and teachers as standards for comparison with aU types 
and races of children between the ages of five and one-half and eighteen years. 
The norms are based on the best available data in this coimtry from the 
Horace Mann School, the Francis W. Parker School, and the University 
Elementary and High schools of the University of Chicago, where a 
limited nimiber of American children were measured consecutively for 
several years by trained anthropometrists using standardized apparatus 
of minute imits, with the age recorded exactiy in days. Details and 

II 
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source material have been published elsewhere/ but the material and 
charts included in this article are new and supplementary to the previous 
larger study. 

GENERAL PRINCIPLES OF GROWTH 

These norms, in accordance with facts previously published by the 
writer, conform with the conclusions that: Boys are taller, heavier, and 
have better lung capacity than girls except during the early adolescent 
period, when the converse of this statement is true. The widest ranges 
of individual differences and the largest increments of growth are during 
adolescence. Individual growth curves previously published show that 
in the course of growth short children do not become tall, neither do 
tall children become short, under normal conditions; each child holds his 
or her relative position in reference to a given median or norm through- 
out the school age — that is, in a well-developed child weight, height, and 
lung capacity are relatively proportionate to each other. If a child's 
weight is divided by its height, the weight-height coefficient is found, 
which is approximately the same for a well-developed large child or a 
similarly well-developed small child; the same relationship holds true 
for the breathing capacity and height or the so-called vital-height coeffi- 
cient, (See score card for norms.) 

STAGES OF PHYSIOLOGICAL MATURATION OR PHYSIOLOGICAL AGE 

Growth is a continuous process, but some periods in the life of a 
child are marked by more acceleration than others. The period from 
six to seven and a half is a period of rather rapid growth in height. Boys 
and girls above median or average height between the ages of six and 
eighteen grow in stature and physiological maturity in advance of those 
below the median or average height. There is a shifting of the acceler- 
ated period according to the individual's relative height, weight, and 
lung capacity. 

Our study of thirty thousand measurements in height, weight, and 
lung capacity reveals correlations in growth for boys and girls above the 
median or average height different from those below. The rhythms 
and fluctuations of growth in height for the children above the median 
show that these boys and girls are physiologically older than those 

» B. T. Baldwin, "Physical Growth and School Progress," U.S. Bureau of Educa- 
tion, BulkUn No. lo, 1914. Whole No. 581. 215 pp. 
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below the median, since their periods of acceleration and arrest begin 
earlier and end earlier. Short children continue their growth longer 
than tall children. 
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This condu^on may be substantiated in another way. Chart I 
^ves individual growth-curves and the periods of first menstruation of 
some girls who were selected, on the basis of height only, from a larger 
group. A study of these curves will show that the taller ^Is, as a rule, 
mature earlier than the shorter ones, as shown by the distribution of 
the advent of first menstruaUon. It would appear, therefore, that 
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height, weight, and breathing capacity offer good objective criteria for 
determining this factor in pubescent development and the onset of 
maturity. If the girl is tall, healthy, and well nourished, this ph3rsical 
stage may be reached as early as eleven years in a normal girl; if she is 
tall, but under weight, it may be delayed; if she is very short and 
markedly light, it may be delayed imtil sixteen and one-half years of 
age.* This principle of growth has recently been upheld by Weissenberg,* 
who f oimd girls who menstruated before thirteen years of age were, on 
the average, 150. 5 centimeters tall, and those who had not developed so 
far at fifteen years of age were, on the average, 144.5 centimeters tall. 
In his study of 1,273 Jews and 768 Russians he found the average of 
this stage of maturation to be for the Jews fourteen years and two months, 
and for the Russians fourteen years and eleven months. Jamasaki 
found the age to be fifteen for Japanese girls and seventeen for Chinese, 
on the average. All of these are relatively short peoples. These 
differences in ages are no doubt also greatly influenced by racial and 
climatic conditions. 

In order to determine the wide range of ages which are characteristic 
of the stages of physiological growth which are entered into at the age of 
adolescence, the writer and one of his advanced students at Johns 
Hopkins University, Charles F. Pennington, checked very carefully 
some material that was gathered by Director William Burdick and Dr. 
Brown on the ages of pre-pubescence, pubescence, and post-pubescence 
in boys.3 In Baltimore 3,600 boys of a "motor" type of development, 
that is, those taking part in athletics, were examined and checked by 
Dr. Burdick and supplemented by a group of 1,317 boys from 14 
coimties of Maryland. Various criteria have been used to determine 
the age of pubescence, such as examination of the teeth, the bones of 
the wrist, the change of voice, the color of the eye, and the acceleration 
in height, weight, and lung capacity. With this particular material the 

'The coefficient of correlation for these ten cases by the Spearman Foimula, 

iJ=i— 7— -~r,is .697. 
(fi»— i) 

* S. Weissenberg, Das Wachstutn des Menschen. Stuttgart : Strecker und Schr5der, 
Z911. 220 pp. 

^ These data were collected under the auspices of the Baltimore Public Athletic 
League of which Mr. Robert Garret is chairman and Drs. Burdick, Brown, Horraz, 
and Thompson are medical supervisors. 
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criterion was that of pubescent growth and pigmentation of fine hair, 
which characterizes a very brief period of time marking the change from 
asexual to sexual life, when the ability to procreate is established. 

Chart n (see p. i6) gives the results of this investigation. 
Cilrves 1, 3, and 5, solid lines, represent the 1,317 country boys. Curves 
2, 4, and 6, dotted lines, represent the 3,600 city bo3rs. It will be 
noticed that the pre-pubescent boys range from eight and one-half to 
sixteen years of age in the group of coimtry boys, and from nine and 
one-half to seventeen and one-half for the city boys. The post-pubescent 
ages range from eleven and one-half to twenty-four for the coimtry boys 
and twelve and one-half to twenty-four for the city boys. For the 
pubescent stages the coimtry boys range from nine and one-half to fifteen 
and one-half, with the mode at thirteen and one-half, and the city boys 
from ten to eighteen, with the mode at fourteen. The average is 13 . 86 
years for the country boys and 14 . 40 years for the city boys. Crampton* 
found the mean age for pubescence (maturing) for New York boys to be 
13.44 years, with a range from twelve and one-half to seventeen and 
one-half years. 

The table shown on p. 17 gives the distribution of 1,241 pre- 
pubescent, pubescent, and post-pubescent girls from the Baltimore Pub- 
lic Athletic League where the criteria were the menstrual flow, the 
appearance of subcutaneous fat, enlargement of the breasts, and 
axillary hair. 

All this material indicates that averages are of little value in the 
study of ph3rsical development. What is needed are individual growth 
records, for each individual must be studied on the basb of his own 
development. Two children fifteen years of age may vary from each 
other at least four years in their stages of physiological development — 
a fact which should be taken into consideration in all educational work, 
whether physical or mental. The results of the writer's previous study 
show that the stages of physical and mental maturity are parallel, 
irrespective of precocity or brightness; therefore, the obvious educa- 
tional corollary is that our school systems, public and private, should 
take into careful consideration the physiological age and the accompanying 
stages of mental maturity of boys and girls, rather than the chronological 
age and brightness, as is now done. This would require that tall, 

' C. W. Crampton, ''Anatomical or Ph3rsiological Age versus Chronological Age,'* 
Ped. Sem., XV, 230-37. 
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healthy children of accelerated physiological development be encouraged 
to proceed through school as rapidly as possible within the limits of 
thoroughness, and that the small, light children of retarded physiological 

APPEARANCE OF PUBESCENT CHANGES IN 1,241 GIRLS 
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development be kept below or in the normal grade, doing supplementary 
work, since these short, light pupils are imnuUure in mental develop- 
ment, although in many cases precocious in degree of brightness. It also 
follows from this study that rapid, healthy growth favors good mental 
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development, and therefore that the healthy growing child should have 
plenty of physical and mental exercise. 

THE MEASURING SCALE 

In order that teachers, principals, superintendents, physical directors, 
and parents may have a basis for comparison in the study of physical 
development, the writer has formulated norms for physical growth' in 
height, weight, and limg capacity, and expressed them on the accompany- 
ing cards (pp. 20-21), which may be used as a measuring scale for physical 
growth and stages of physiological maturity, as well as for records con- 
cerning physical conditions. The norms are high, representing the best 
developed children available, who have had physical training, school- 
medical inspection, directed play, and remedial treatment where neces- 
sary. A child who falls short of these standards is not necessarily 
subnormal physically, providing its weight and breathing capacity are 
proportionate to its height. The weight-height coefficients and the 
vital-height coefficients indicated on the card under their respective ages 
mark the norm to which all well-developed children should approxi- 
mate.^ All these norms are based upon measurements of nude children. 

• 

' Measuring scales for the growth of boys and girls have been prepared in the 
metric system and may be had from the writer on application. An illustrated leaflet 
describing methods of measuring and tests for nutrition, vision, hearing, neck-glands, 
and posture may also be obtained from the writer. 



CHAPTER n 

NOTES ON THE DERIVATION OF SCALES IN SCHOOL SUBJECTS: 
WITH SPECIAL APPLICATION TO ARITHMETIC 



B. R. BUCKINGHAM 
Chief Statistician, Department of Education, New York City 



The movement to set up objective means of measuring school prod- 
ucts, which has been so characteristic of recent educational practice, 
has plainly demonstrated the necessity for more and better instnunents 
of measurement. It is in response to this need that standards of achieve- 
ment have been set up, and scales have been derived. The latter have 
been of two kinds — those based upon the judgment of competent per- 
sons, and those based upon the ratio of correct to total responses in a 
typical group. The validity of each of these bases has been questioned, 
but not successfully. The superiority of the one over the other has been 
argued, but not conclusively. In fact, there is no opposition between 
them. 

The determination of the ratio of correct responses to total responses 
is also, to some extent, dependent upon individual judgment, because 
it is frequently a matter of opinion whether a response is correct or not. 
In the matter of spelling, for instance, it is not always easy to say whether 
a given form is or is not to be scored as correct. Again, in arithmetic, 
which, like spelling, is capable of relatively precise rating, it is frequently 
difficult to decide whether the answer to a problem should be rated as 
correct. In such cases readers of papers will differ somewhat in their 
conclusions. In other words, the element of individual judgment plays a 
part. Furthermore, such subjects as geography, history, and English 
offer much greater degrees of difficulty in the application of that preci- 
sion of rating upon which the ratio method of deriving scales is based. 

Finally, in the gradation of school subjects from the most dej&nite 
subjects (spelling and arithmetic) to the least definite ones (penmanship, 
drawing, and English composition), we reach subjects in which the ele- 
ment of certainty is at a minimum, and judgment plays its most 
important rdle. 

23 



24 THE FIFTEENTH YEARBOOK 

The point which I am seeking to make is this: that there is no oppo- 
sition between scales based upon judgment and those based on the ratio 
of correct to total responses, and that each method of derivation is most 
appropriate at the extremes of a series of school subjects ranging from 
most definite to least definite. 

On the score of penmanship, drawing, and English composition, a 
given specimen of work is superior to another, not because it is more 
correct, but just because people think it is superior. On the other hand, 
in the case of spelling, a list of words written by one child is better in 
point of spelling than a list written by another child, not because a nimi- 
ber of judges think it is the better, but because there are actually more 
words spelled correctly in it. 

In those subjects that range between the extremes of definiteness 
(such subjects, namely, as geography, history, and granunar) it will be 
evident that there is place for both the judgment and ratio methods of 
scale-derivation. In each of these subjects there are certain parts which 
are so definite and about which people differ so little that there is small 
room for variation in judgment. In geography, for example, locational 
features are of this type. It is no more possible for people to differ 
about the state of the United States in which Kalamazoo is than it is 
for them to differ about the correct spelling of "separate" or the product 
of seven and nine. Similarly, in history, the question "In what year 
was the Stamp Act passed?" admits of no debate. And, again, in 
grammar, the direction "Give an example in a sentence of an adverb 
of time, and imderline it" admits of responses which may be classified, 
with practical certainty, as either right or wrong. 

It will be noted that the questions just mentioned call for responses 
based on information, and it is a fact that most questions which may be 
rated with precision as either right or wrong are of this kind. It is 
obvious, however, that a large part of geography, and perhaps a still 
larger part of history and grammar, cannot be covered by questions of 
this character. Indeed, the most valuable training to be derived from 
these subjects is based upon the opportunity which they afford for com- 
parison, for inference, and for judgment. 

But there is no good reason why scales based upon the ratio idea 
should not be derived for those phases or parts of these subjects that are 
susceptible of the precise treatment which the ratio idea requires. In 
fact, it is becoming increasingly evident that the present general scales 
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will have to give place to more specific ones, each scale being suitable 
for a particular purpose and applicable to a given condition or situation. 
We shall have scales for each grade in spelling, scales for the several 
styles of handwriting, and scales for each type of discourse in composi- 
tion. Why, then, should we not have scales for information in geog- 
raphy, history, and grammar? 

The suggestion may be made at this point that in using scales based 
upon information, we may not only directly measure ability to give 
information, but we may also indirectly measure ability of a more general 
sort, including the power to think. Work is now being done on the prob- 
lem of the correlation between information and general ability within 
a school subject. From present indications there is reason to suppose 
that the correlation is high — ^probably not less than 0.80. li this is 
substantiated by sufficient data, it then becomes reasonably easy to 
measure something like general ability in a given field in terms of a 
scale derived from questions of information. 

The practicability of indirect measurement is demonstrated in many 
of our ordinary measurements. We do not measure, for instance, the 
heat of the atmosphere, but, rather, the length of a mercury column, 
which varies directly with the amoxmt of heat to which it is subjected. 
We do not measure the health of a child, but, rather, his vital index, 
because we either know, or think we know, that his health varies 
approximately with this index. 

When we use the phrase "varies directly," we are stating a condition 
which involves perfect correlation. No such perfect correlation, of 
course, exists between mental processes. A measure, therefore, of one 
process, trait, or ability in terms of another, is liable to a margin of 
error to the extent that the correlation is imperfect li we may assume 
that the correlation between information and thought-power in geog- 
raphy is o . 80, we cannot get a perfect measure of " thought-power " from 
"amoimt of information," but we can get a measure which differs from 
the true one by an amoimt small enough to be negligible for many 
practical purposes. 

With these ideas in mind, an investigation was begim in the fall of 
19139 which had for its purpose the development of standardized material 
and the derivation of scales in the subjects of arithmetic, geography, 
history, and grammar, upon the basis of the ratio of correct to total 
responses to given questions. It is to be imderstood that in the rating 
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of pupils' papers, all answers were scored as either correct or not correct, 
and that no part credits were given. 

The report herewith submitted is preliminary and fragmentary. 
It is preliminary because it is not believed that a sufficient number of 
cases have been scored to make the conclusions as reliable as they should 
be. It is fragmentary because results are shown only for the subject 
of arithmetic, and within this subject, for only a portion of the questions 
that were used. It is offered here as an example of the extension to a 
wider field of a previously used method. 

The problems used in this report were given to seventh- and eighth- 
grade children in eight schools in New York City, and to children of the 
same grades in ten other cities. Not all the problems were used in every 
dty. The number of participants, therefore, varies with different 
questions. In no case, however, was a problem attempted by less than 
S,ooo children. 

The tests were administered by the class teachers, imder instructions. 
The principal point in the instructions was that the problems were to 
be written on the blackboard, one at a time, and that ten minutes were 
to be allowed the pupils for solving each problem. 

In rating the papers, children were scored as correct only in case the 
answer to the problem was correctly given. In a few instances, where the 
teacher had evidently presented an example incorrectly, and the change 
did not affect its nature or apparent difficulty, it was scored as correct 
if the pupils gave the right answer imder the changed condition. In the 
few instahces where changes were introduced by the teacher which 
affected the nature and difficulty of the problem, no record was taken 
of the results. 

The problems listed under Table I were given, in a preliminary test, 
to children in several cities other than New York City, and in a test ^ 
of eight schools of a certain type in New York City, on March 23, 1915. 
In order to distinguish them from the problems shown imder Table II, 
they are called the "March test." 

The problems listed imder Table II were given, in a preliminary test, 
to children in a number of cities other than New York City, and were 
then given, also, to the same eight schools of New York City, on June 24, 
1915. For convenience in designation, these problems are called the 
"June test.'* 
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635 






804 



671 



goQ 



3,019 



The ten problems used in the March test are the foUowing, their numbers cor- 
responding to tlie numbers in the table above; 

1. If s. map 10 in. wide and 16 in. long is made on a scale of 30 mi. to the inch, 
what is the area in square miles tliat tlie map represents ? 

i. Cream is sold in j-pint bottles. If a inilltmHn buys it at Si . 20 a gallon and 
it costs 40 cents a gallon to bottle and deliver it, at what price per bottle must it be 
sold to gain so per cent ? 

3. A fruit dealer bought 300 apples at the rate of 5 for a cent, and 300 at 4 for 
a cent. He sold them all at tie rate of 8 for S cents. What did he gain on tlie invest- 

4. A family used i) bu. of potatoes a month. How much will be saved each 
month by buying them at $1.30 a bushel instead of at S cents a quart? (8 qts.^ 
I pk.; 4 pks.=i bu.) 

5. James buys papers at 10 for 6 cents and sells them at t cent each. If his 
sales average 100 a day for 6 days, what does be add to the family income after keeping 



oforU 



If? 



6. The 7A class has 43 on the roll and only 3 absent today; and the 7B class has 
48 on the roll with 4 absent. Which has the better percentage of attendance and how 

7. Bought pendla at $1 . 20 per gross, and sold them at i cent each. Find the 
gun per cent. 

8. A family pays $35 a month for a non-heated flat and uses 3 tons of coal at 
I7 per ton for heating purposes during the winter. If it moved to a stesm-heated 
flat at $30 a month, would it increase its expenses for the year or not, and how much ? 
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9. The value of the men's factory products in the leading centers of the United 
States was as follows: 

z86o zgoo 

New York $17,011,370 $103,220,201 

Baltimore 3,124,342 17,290,825 

Boston 4,567,749 8,601,431 

Chicago 540,709 36,094,310 

Philadelphia 9,962,800 18,802,637 

Find the increase or decrease in the value of the men's factory products in 1900 as 
compared with that of i860. 

10. Two boys made a gallon of lemonade, using 16 lemons at 30 cents a doz. and 
3 lbs. of sugar at 6 cents a pound. They sold it at 5 cents a glass, 6 glasses to a quart. 
How much was each boy's share of the gain ? 

TABLE n 

Distribution of Corsect Answers by Questions and by Grades 

Arithmetic. June Test 



Probleu 
Numbers 



I 

3 

3 

4 

5 
6 

7 
8 

9 
10 





Seventh Grade 




First 


Half 


Second Halv 


No. of 
Partici- 
pants 


No. 
Correct 


No. of 
Partici- 
pants 


No. 
Correct 


1,505 


313 


1,478 


358 


1,442 


152 


1,454 


189 


1,442 
1,508 


796 
988 


1,454 
1,544 


933 
1,164 


1,442 
1,508 
1,526 
1,442 

1,594 


978 
452 
778 
556 
481 


1,499 

1,544 

1,754 

1454 
1,604 


1,192 

653 
i,io8 

783 
616 


1,442 


519 


1,454 


724 



Eighth Grade 



First 


Half 


Second 


No. of 
Partici- 
pants 


No. 
Correct 


No. of 
Partici- 
pants 


1,163 
1,091 
1,091 
1,129 


354 
167 

750 
881 


1,104 
1,166 
1,166 
1,192 


1,091 


931 


1,134 


1,129 
1,257 


515 
898 


1,192 
1,261 


1,091 
1,214 


593 
572 


1,124 
1,248 


1,091 


514 


1,124 



No. 
Correct 



515 

277 

922 
991 
1,046 
696 
988 
801 

785 
774 



Total 



No. of 
Partici- 
pants 



5,250 

5,153 

5,153 

5,373 
5,166 

5,373 
5,798 

5,"i 
5,660 

5,1" 



No. 
Correct 



1,540 

78s 
3,401 
4,024 

4,147 
2,316 

3,772 
2,733 
2,454 
2,531 



The ten problems used in the June test are the following, their numbers cor- 
responding to the numbers in the table above: 

1. A f^mer has a herd of 12 dairy cows that average 22 pounds each of milk per 
day. The milk contains 3 . 8 per cent butter-fat, and butter-fat is worth 38 cents per 
pound. What is the daily income from the herd ? 

2. I am making a handkerchief out of a piece of linen io| in. square. If I make 
a }-in. hem all around it, how long and wide will it be when finished ? 

3. If Texas is 313.06 times as large as Rhode Island, and New York is 39.44 
times as large as Rhode Island, then Texas is how many times as large as New York ? 
Express to the nearest second decimal place. 
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4. According to the report of the Bureau of Census the numbers of persons engaged 
in the different groups of occupations in the United States in 1880 and 1910 were as 
follows: 

Group z88o zgzo 

1 7,7i3i87S 12,567,925 

2 1,871,503 7,605,730 

3 3,784,726 10,807,521 

4 603,202 1,825,127 

s 3,418,793 5,361,033 

Find the total increase in the number of persons employed in the United States in 
1910 over those employed in 1880. 

5. A can of milk containing 40 quarts costs $1 . 60. What percentage is gained 
by selling the milk for 6 cents a quart ? 

6. I bought a cask of molasses containing 84 gallons for $28. Nine gallons hav- 
ing leaked out, at what price per gallon must I sell the remainder to gain $4. 25 ? 

7. A farmer's wife bought 2 . 75 yards of table linen at $0 . 87 a yard and 16 yards 
of flannel at $0 . 55 a yard. She paid in butter at $0 . 27 a pound. How many pounds 
of butter was she obliged to give ? 

8. A man and boy together spaded i|^ of a garden. If the man spaded twice 
as much as the boy, what part of the garden did each spade ? 

9. A contractor completed f of a job in 12} days. How much longer should 
it take to finish the job ? 

10. In a certain state the cost of building a macadam road is shared by the town, 
county, and state. The state pays i, the county i, and the town the remainder. 
If the state pays $1,200, what does the town pay? 

On the basis of the preliminary testing, the first problem in the March 
test was supposed to be of equal difficulty with the first problem in the 
Jxme test; the second problems in both tests were, likewise, supposed 
to be equal in difficulty; and similarly for the remaining problems. 
This equality has no particular interest in the present report, and the 
equality b obscured by the fact that the Jime test was given at the very 
end of the school year. 

Tables III and IV are based upon Tables I and II, respectively, and 
show, for each problem and for each grade, the percentages of pupils 
who obtained correct answers. They also show, as a better expression 
of the difficulty of the problems, and, consequently, of the ability required 
for their solution, the equivalents of the percentages, in terms of that 
unit of variability of the curve of error known as the "Probable Error." 
It is, of course, a well-known fact that there is an illusion in percentage 
ratings, due to the fact that the distribution of ability does not take 
rectangular form, but, rather, that of a logarithmic curve of approxi- 
mately "normal" type. Accoxmt of this distribution is taken when 
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TABLE m 

Percentages of Correct Answers for Each Problem and for Each 

Grade, with P.E. Equivalents 
Arithmetic. March Test 





Ml 


Seventh Grade 


Eighth Grade 


m. 




Problem 
Number 


First Half 


Second Halt 


First Halt 


Second Hal? 


Total 


Per- 
centage 
Correct 


P.E. from 
Median 


Per- 
centage 
Correct 


P.E. from 
Median 


Per- 
centage 
Correct 


P.E. from 
Median 


Per- 
centage 
Correct 


P.E. from 
Median 


Per- 
centage 
Correct 


P.E. from 
Median 


I 

2. 

3 

4 

5 
6. 

7 
8 

9 

lO. 




94 
23. 7 
44.7 
34.9 
35.6 
26.7 
51.2 
33.8 

47.1 
39.8 


+ 1.95 
+1.06 

+0.20 

+0.58 

+0.55 
+0.92 

—0.04 

+0.62 

+O.II 

+0.38 


II. 2 
31.0 

54.9 
42.8 
49.0 

35-4 
62.5 

43.3 
51.9 
50.1 


+1.80 

+0.74 
-0.18 
+0.27 
+0.04 
+0.56 
-0.47 
+0.25 
—0.07 

— O.CXJ 


23.8 
45.2 
66.7 

53.4 
56.8 

44.1 

72.5 

51.7 
62.0 

55.3 


+1.06 
+0.18 
—0.64 
—0.13 
—0.25 
+0.22 
-0.89 
—0.06 
-0.45 
—0.20 


39.9 
61.7 

76.4 

72.5 
70.2 

54.3 
78.9 

69.1 

65.8 

72.8 


+0.38 
-0.44 

— 1.07 
-0.89 
-0.79 
—0.16 

— 1. 19 
-0.74 
—0.60 
—0.90 


19.8 

39.0 
59.4 

49.5 
51.8 

39.0 
65.1 
48.1 

55. S 

53.3 


+1.26 
+0.41 
-0.3s 
+0.02 
—0.07 
+0.41 

-0.58 
+0.07 

—0.21 

—0.12 



TABLE IV 

Percentages of Correct Answers for Each Problem and for Each 

Grade, with P.E. Equivalents 
Arithmetic. June Test 





Seventh Grade 


Eighth Grade 


»p_ 




Probi.em 

NUMBERi 


First Halt 


Second Halt 


First Half 


Second Halt 


lOXAL 


Per- 
centage 
Correct 


P.E. from 
Median 


Per- 
centage 
Correct 


P.E. from 
Median 


Per- 
centage 
Correct 


P.E. from 
Median 


Per- 
centage 
Correct 


P.E. from 
Median 


Per- 
centage 
Correct 


P.E. from 
Median 


1. . . 

2. . . 

3... 

s .. 

6... 
7... 

8... 

9... 

10.. . 


20.8 

I0.5 
55.2 

65.5 
67.8 

30.0 
51.0 
38.6 
30.2 
36.0 


+ I.2I 

+1.86 
—0.19 

-0.59 
—0.69 

+0.78 
—0.04 

+0.43 
+0.77 

+0.53 


24.2 

13.0 
64.2 

75.4 

79.5 

42.3 
63.2 

53.9 
38.4 
49.8 


+1.04 

+1.67 

-0.54 
— 1.02 

-1.22 

+0.29 

-0.50 

-O.IS 

+0.44 

+0.01 


30.4 
16.6 

68.7 
78.0 

85.3 
45.6 

71.4 

54.4 

47-1 
41. 1 


+0.76 

+ 1.44 
—0.72 

-1. 15 
-1.56 
+0.16 

-0.84 
—0.16 

+O.II 

+0.33 


46.6 
23.8 
79.1 

83.1 
92.2 

58.4 
78.4 

71.3 
62.9 

68.9 


+0.13 
+ 1.06 

— 1.20 
-1.42 

— 2.10 
-0.32 
-1. 17 
-0.83 
-0.49 
-0.73 


29.3 
15.2 
66.0 

74.9 
80.3 

43-1 
65.6 

53-5 
43.4 
49.1 


+0.81 

+1.52 
—0.61 

— I.oo 

— 1.26 
+0.26 
—0.60 
-0.13 
+0.25 
+0.03 
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percentage values are thus converted into some unit of variability of 
the cxurve of error." 

The twenty problems listed in Tables I-IV, as has been stated, were 
given in March and in Jime, 1915, to typical schools in New York City. 
On the basis of the returns received from these schools, the figures given 
in Tables V and VI were made up. These figures refer to the scores of 
individuals. As measures of the ability of groups of children, these 
tables may prove useful. They are, however, only approximations. 

TABLE V 

DiSTsiBunoN OF Pupils according to the Number of Problems Answered 

Correctly 

Arithmetic. March Test 



No. OF 
Problems 

CORSECT 


Grade VII> 


Grade VII' 


Grade VIII« 


Grade VIII' 


Grades VII' to 
VIII- 


No. 


Percent- 
age 


No. 


Percent- 
age 


No. 


Percent- 
age 


No. 


Percent- 
age 


No. 


Percent- 
age 




I 

2 

3 

4 

5 

6 

7 

8 

9 

10 


190 
230 
160 
204 
161 

156 

114 

98 

77 

43 

9 


13 -2 
16.0 
II. I 

14. 1 

11. 2 
10.8 

7.9 

6.8 

5.3 
30 
0.6 


144 

157 
147 
154 
178 

147 
150 
126 
121 
107 

9 


8.1 
II. I 
10.4 
10.9 

12.6 

10.4 
10.6 

8.9 
8.6 
7.6 
0.6 


43 

73 
88 

96 

112 

132 
131 
136 
125 
96 

59 


3.9 
6.7 
8.1 

8.8 
10.3 
12. 1 
12.0 
12.5 

"5 
8.8 

5.4 


6 
18 
42 

51 

67 

"5 
117 

160 

163 

189 
114 


0.6 

1.7 
4.0 

4.9 
6.4 

11. 

"3 
15.4 
15.6 

18. 1 
10.9 


353 
478 

437 
505 
518 
550 
512 
520 
486 

435 
191 


7.1 
9.6 

8.8 
10. 1 
10.4 
II. 
' 10.3 
10.4 

9.8 

8.7 
3.8 


Total 

Median. . . 


1,442 
2.691 




1,410 
4.747 




1,091 
6.015 




1,042 
7.656 




4,985 
5.367 





The fact that the ten problems upon which each of these tables is based 
varied widely in point of difficulty makes conclusions as to individual 
abilities somewhat imreliable. Tables made up from material each part 
of which was of equal difficulty would be more reliable, but no such tables 
have ever been constructed, for the reason that no material meeting these 
conditions exists. Meanwhile, therefore, we shall be obliged to content 
ourselves with the usual method of approximation. With this caution 

' For conversion tables see £. L. Thomdike, Mental and Social Measurements , 
2d ed., p. 228; also B. R. Buckingham, Spelling Ability^ Its Measurement and 
Distribution, p. 116. 
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in mind, Tables V and VI may be used as standards of attainment. 
Figs. 1-8 show, in graphic form, the frequencies of each rating as given 
in these tables. 

TABLE VI 

dlstsibxttion of pupn^ according to the number of problems 

Answered Correctly 

Arithmetic. June Test 



No. OF 


Grade VII' 


Grade VII' 


Grade Vm> 


Grade VIII- 


Grades Vil' to 

vm« 


Problems 

COKSECT 


No. 


Per- 
centage 


No. 


Per- 
centage 


No. 


Per- 
centage 


No. 


Per- 
centage 


No. 


Per- 
centage 


o 

I 

2 

3 

4 

5 

6 

7 

8 

9 

lO 


67 
144 

193 
235 

211 
204 

143 

97 
70 

54 
24 


4.6 
10.0 

13.4 
16.3 

14.6 

14. 1 

9.9 
6.7 
4.9 
3.7 

1.7 


28 

65 

95 

165 
200 

243 
204 

189 
134 

69 
18 


2.0 
4.6 

6.7 
II. 7 
14.2 
17.2 

14.5 

13.4 

9.5 

4.9 

1.3 


13 

32 

71 
III 

171 

167 

146 

142 

129 

79 
30 


1.2 

6.5 
10.2 

15.7 
15.3 
13.4 
13.0 
II. 8 
7.2 
2.7 


4 

4 

27 
62 

73 
116 

145 
184 

159 
189 

79 


0.4 
0.4 
2.6 
6.0 
7.0 
II. I 

13.9 

17.7 

15.3 
18. 1 

7.6 


112 

245 
386 

573 
655 
730 
638 
612 
492 

391 
151 


2.2 

4.9 

7.7 

"5 

13. 1 

14.6 

12.8 
12.3 

9.9 

7.8 
3.0 


Total 

Median. . . 


1442 
4.389 




I^IO 

5.626 




1,091 
5.886 




1,042 
7.489 




4,985 
5.715 





Fig. 9 shows, for each grade, in the form of a scale, the facts with 
respect to the difficulty of the problems that were shown in the columns 
headed " P.E. from Median" in Tables III and IV, although the problems 
of the Jime test are not strictly comparable to those of the March test, 
on the basis of the returns received, for the reason that there is an 
increment of ability among school children during a three months' 
period. The two sets of problems are scaled on the same projection, but 
they are kept separate by showing, in Fig. 9, the numbers of the March 
problems above the scale line, and the numbers of the Jime problems 
below the scale line. 

Fig. 9 also shows a general scale for the four grades combined; 
the point of reference is the median of Grade VII^ In order thus to 
refer the results of the testing in higher grades to the median of the lowest 
grade, it is necessary to know the intervals between the medians of the 
successive grades. 
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Tables VII and Vni show, for the March and June tests, the number 
of pupils in each grade who equaled or exceeded the score of the median 

TABLE Vn 

Amount and Percentage of Overlapping with P.£. Eqxtivalents 

Arithmetic. March Test 



Grade VIP, 



Grade Vn« 



Grade Vin«. 



Grade Vm» 



No. 

Percent 

P.E. 

No. 

Percent 

P.E. 

No. 

Per cent 
P.E. 

No. 

Percent 

P.E. 



Grade Vn> 



1038 

73.6 

•0.94 

915 

83.9 
•1.47 

989 
950 
■2.44 



Grade Vn> 



538 

37.3 
+0.48 



708 

64.9 

-0.57 

87s 
84.0 

— 1.48 



Grade Vm> 



340 

25.3 
+0.99 

S" 
36.2 

+0.52 



742 

71.2 

-0.83 



Grade Vm* 



163 

II. 3 

+1.80 

281 
19.9 

+I.2S 

327 

30.0 

+0.78 



Table reads: 538 pupils of Grade Vn* equaled or exceeded the score ci the mediaii pupil of grade 
Vn% which was 37.3 per cent of all pupils of Grade Vn>. The equivalent of this percentage is 0.48 
PJS., etc. 

TABLE Vm 

Amount and Percentage of Overlapping with P.E. Eqxtivalents 

Arithmetic. June Test 



Grade VIP 



Grade Vn«. 



Grade vm* 



Grade vm*. 



No. 

Percent 

P.E. 

No. 

Percent 

P.E. 

No. 

Per cent 
P.E. 

No. 

Percent 

P.E. 



Grade Vns 



980 

69.5 
—0.76 

789 

73.1 
—0.91 

917 
88.1 

-1.7s 



Grade Vn> 



465 
32.2 

+0.69 



589 
54.0 

•0.15 

800 

76.8 

•I. 09 



Grade Vm> 



412 

28.6 

+0.84 

642 

45.5 
+0.17 



770 

73.9 
•0.95 



Grade vm* 



198 

137 
+1.62 

318 

22.6 

+I.I2 

311 

28. s 

+0.84 



Table reads: 465 pupils of Grade VII' equaled or exceeded the score of the median piq>il of 
Grade Vn'» which was 32.2 per cent of all pupils of Grade vn*. The equivalent of this peroentag is 
0.69 P.E., etc. 
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Figs, x, a, 3, and 4. — ^Frequency of each rating (of problems oorrect) in Gn 
for problems answered correctly. Hie vertical scale is for the percentage of cfaik 
Grade 7'; 2,091 for Grade 8'; and 1,042 for Grade 8*. 
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Figs. 5, 6, 7, and 8. — Frequency of each rating (of problems correct) in Gxac 
for problems answered correctly. The vertical scale is for the percentage of dukb 
Grade 7'; 1,091 for Grade 8'; and 1,042 for Grade 8*. 
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% 8% and 8*, respectively. June test. (See Table VI.) The horizontal scale is 
obtained each correct nimiber of answers. N-^ 1,442 for Grade 7'; i^io for 
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pupil of each of the other grades. They also show the percentages and 
P.E. values corresponding to these numbers. The P.E. values are the 
intervals between the grade medians. These tables are constructed 
upon the assmnption of a normal distribution of ability in all grades, 
and upon the further assimiption that the variability in any one grade 
is equal to the variability in each of the other grades. 

Obviously, we have several expressions for the same relationship; for 
instance, in Table VIII, the distance between the median of Grade VII' 
and the median of Grade VII^ is (column 4) 0.69. In the same table, 
the same distance measured in the opposite direction is 0.76. Two 
similar values for the same distance are shown in Table VII; and besides 
these four measures, a niunber of others may be derived. Using, how- 
ever, only direct statements of the relationship between consecutive 
medians, we have, in each case, four quantities. The averages of these, 
being taken, give the following results: 

Median of Grade VIP to median of Grade VIP =0.72 P.E. 



(( 


ii 


(( 


VU« " 


(( 


a 


it 


VTn'=o.37 P.E. 


ti 


tt 


(( 


VHP " 


(( 


tt 


tt 


VTTP= 0.8s P.E. 



To obtain the general scale shown in Fig. 9, all that is necessary to 
do now is to add to the P.E. values of Tables III and IV, for grades 
higher than VII^ the interval at which the medians of these grades 
stand above the median of Grade VII^ By so doing, three values in 
addition to the one for Grade VII' will be found, and the average of these 
four may be taken as the best position at which to "place" the problem 
in question. 

Table IX gives the distance at which each problem stands above 
the median of Grade VII' when computed on the basis just described. 
The general scale in Fig. 9 ,is the graphic representation of this 
table. 

It is clear that the scales derived in this paper are very meager, 
and, as was said in the beginning, this report is merely preliminary and 
suggestive. A far greater nvmiber of problems in arithmetic should be 
used for the purpose of constructing a more complete scale. In fact, 
120 such problems are now being worked up with this end in view. 
Material is likewise in hand for a large nvmiber of questions in geog- 
raphy, history, and grammar, which will be scaled in the same way. 
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Any superintendents or principals who are willing to give tests in these 
subjects are invited to communicate with the writer of this chapter. 

TABLE DC 

Average PosmoN of Problems, Ex- 
pressed AS Distances troh the 
Median of Grade Vn and in Units 
OF P.E. 



Problem 



I 
2 

3 

4 

S 
6 

7 
8 

9 

lO 



MRn:h 


2.24 


1.32 


0.52 


0.90 
0.83 


1.32 


0.29 
0.96 
0.69 
0.76 



June 



1.72 

2. 45 
0.28 

•o.ii 

■0.46 

1. 17 

0.30 

0.76 

I. IS 
0.97 



CHAPTER in 
SCORE CARD FOR CITY SCHOOL BUILDINGS 



GEORGE DRAYTON STRAYER 
Professor of Educational Administration, Teachers Collie, Columbia University 



The score card which is printed herewith has been developed as 
a part of the advanced work in educational administration under the 
direction of the author of this article, with five different groups of grad- 
uate students, through two academic years and one simmier session.' 
The idea of a score card has been common over a considerable period of 
years, especially in the work of agricultural colleges. There is a mani- 
fest advantage in the score card in that it fixes attention upon all of those 
qualities or elements which go to make up the perfect whole desired. 
Individuals in judging school buildings not infrequently think mainly 
in terms of two or three elements which seem to them to be of primary 
importance, and often neglect other parts of the building which are, 
when one stops to consider them, of equal value. In making the score 
card, it has been necessary first of all to include as nearly as possible 
all those details which go to make up the perfect school building. It 
was, of course, desirable, in so far as it was possible, to include under 
a few main heads all the subordinate factors. It was only after a very 
considerable amount of experimentation that the heads "Site," "Build- 
ing," "Service Systems," "Classrooms," and "Special Rooms" were 
decided upon. 

After organizing the score card in terms of the large and the sub- 
ordinate heads, the next step was, of course, to assign to each main and 
each subordinate head the proper weight out of a total of a thousand 
points which was allowed as a perfect score. The method employed was 

' Special acknowledgment is due to Messrs. L. H. King, B. W. Loomis, and 
A. Dushkin, who were constituted as the first committee to draft a score card for 
school buildings, and whose work was used as a basis for discussion in the subsequent 
development of the form which is here printed. The author is indebted to Dr. M. R. 
Trabue for the statistical calculations necessary to determine the weights to be assigned 
to each of the several items. 

41 
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to ask experienced superintendents and principals of schools taking 
work in educational administration, which involved a considerable 
knowledge of statistics, to assign to each element the weight which they 
thought should be attached. The five large heads were scored first, 
next the several main subdivisions under each large head, and finally the 
elements imder the last-named divisions. More than two himdred 
students participated in this part of the work. From the ratings assigned 
by the last group of a hundred students working upon the score card, 
after studying the results which had already been secured by the former 
groups, medians were calculated, first, for the large heads, and then for 
each of the subordinate heads. The medians were calculated only to the 
nearest five points on the scale. This means that the score card as it 
appears represents the combined judgment of the scorers to within two 
and one-half points. In many cases, of course, the median fell on five 
or some multiple of five, in which case the score given corresponds exactly 
to the median foimd. 

The method employed in determining the weight to be assigned to 
each element appearing on the score card n^eds no particular defense, 
since the value of any particular part or element in the construction of 
the building is, after all, a matter of judgtiient. The median judgment 
derived from the scores allowed by a large group of those competent to 
judge of the worth of the several elements is the best single measure 
which can be found. 

In order to use the score card, one should be familiar with the prob- 
lems involved in schoolhouse construction. To that end, there appears 
at the end of the score card a bibliography. It would be well, in training 
people to use the score card, to have them thoroughly conversant espe- 
cially with the more important authorities on the subject of school 
hygiene and school architecture. After such study, visits to buildings, 
imder the guidance of some competent student of these problems, would 
add greatly in training persons to use the card. The card is given first 
in a very brief and highly condensed form, which could be used only by 
those entirely familiar with the longer form and with the meaning of 
each of the headings which is there listed. As a matter of practice, it 
will be best first to use the longer form of the score card, and, only, after 
considerable facility has been acquired, to drop the longer form in favor 
of the shorter summary. For one familiar with school buildings and 
with the score card, much would be gained by checking over blueprints 
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and specifications in the light of the score card before beginning to con- 
struct the building. Here again the value is in large measure to be 
found in the fact that each of the more important items will be brought 
to the attention of the one who seeks to criticize the plans and specifi- 
cations, and their relative importance will at least in some measure be 
indicated. 

It will be found particularly worth while to score old buildings, in 
order to call attention to the necessity for reconstruction which is always 
to be f oimd in a city in which buildings have been in use over a consider- 
able nimiber of years. As ohe studies the problem of school buildings 
in the United States, he is impressed by the accidental or occasional 
repair or reconstruction which is provided. A careful study and scoring 
of these buildii^s will often indicate common deficiencies of very great 
importance which should receive immediate attention, and others which 
are of relatively less significance which may be postponed for a time. 
In the same school system it may be foimd as well that one building is 
so remarkably more deficient than another that it is manifestly good 
public policy to spend whatever money is available in reconstructing 
the buildings which scores lowest before imdertaking the work which 
may not be nearly as important in other buildings. 

In the case of scoring school buildings, as with any other instnunent 
of measurement, the result should suggest problems, and in some measure 
indicate the direction in which reforms are to be brought about. Any 
person using the score card should supplement the mere scoring of the 
several items with a report upon any notable deficiency which renders 
the building imfit for use. It is entirely conceivable that a building on 
most coimts might stand high, but in some one particular, say with 
respect to fire protection or sanitation, might rate as entirely imsatis- 
factory. In this case the notation, after the building was scored, would 
call attention to the fact that measures should be taken immediately 
to remedy particular defects, in which case the building would, possibly 
with a minimum of expense, be brought up to a very high standard of 
excellency. 

The writer will be very glad to receive, from anyone who may use 
the score card, criticisms or suggestions for its improvement. It wiU 
be particularly helpful to receive reports of the use of the score card, 
showing to what degree two or more individuals scoring the same build- 
ing arrive at the same result. 
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SCORE CARD FOR SCHOOL BUILDINGS AND EQUIPMENT FOR CITY 

ELEMENTARY AND HIGH SCHOOLS 

City Building 

Principal Date 

Enrolment: Bo3rs Girls Total 

Average Daily Attendance: Bo3rs Girls Total 

Number of Rooms Approximate Cost 

Scorer 

Instructions 

X. Abbreviation: S — standard. 

2. Basis for scoring — i, coo points. 

3. In scoring classrooms, stairwa3rs, entrances, fire escapes, and the like, score each 
separately and insert the average for the final score. 

4. It will be worth while to use this card in checking up blueprints of prospective 
buildings. To do this will require a complete set of specifications with the blue- 
prints, also a copy of state laws and dty ordinances. 

« 

SHORT FORM OF SCORE CARD 

I. Site (125) 

A. Location (55) 

I. Accessibility (25) 2. Environment (30) 

- B. Drainage , (30) 

I. Elevation (20) 2. Nature of Soil (10) 
C. Size and Form (40) 

n. Building (165) 

A. Location (25) 

I. Orientation (15) 2. Position on Site (10) 

B. External Structure (60) 

I. Type (s) 2, Material (10) 3. Height (5) 

4. Roof (5) 5. Entrances (10) 

6. Aesthetic Balance (10) 7. Condition (15) 

C. Internal Structure (80) 

I. Stairwa3rs (35) 2. Corridors (25) 3. Basement (15) 

4. Attic (s) 

m. Service Systems (280) 

A. Heating and Ventilation System (70) 

I. Kind (20) 2. Installation (10) 3. Air Supply (25) 

4. Distribution (15) 

B. Fire Protection S3rstem (65) 

I. Apparatus (10) 2. Fireproofness (20) 3. Escapes (20) 

4. Electric Wiring (s) 5. Fire Doors (10) 
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C. Cleaning System (20) 

D. Artificial Lighting S3rstem (20) 

£. Electric Service S3rstems (15) 

I. Clock (s) 2. Bell (s) 3. Telephone (s) 

F. Water Supply S3rstem (30) 

G. Toilet System (50) 

I. Distribution (10) 2. Fixtures (10) 3. Adequacy (10) 

4. Seclusion ($) 5. Sanitation (15) 

H. Mechanical Service Systems (10) 

I. Elevators (5) 2. Book-Lifts (2) 3. Waste-Chutes (3) 

IV. Classrooms (290) 

A. Location and Connections (35) 

B. Construction and Finish (90) 

I. Size (25) 2. Shape (15) 3. Floors (10) 

4. Walls (10) 5. Doors (5) 6. Closets ($) 

7. Blackboards (10) 8. Color-Scheme (10) 

C. Illumination (85) 

I. Glass Area (45) 2. Windows (30) 3. Shades (10) 

D. Cloakrooms and Wardrobes (25) 

E. Equipment (ss) 

I. Seats and Desks (40) 2. Teacher's Desk (10) 

3. Bulletin Boards (5) 

V. Special Rooms (140) 

A. Large Rooms for General Use (65) 

I. Pla3rroom (10) 2. Auditorium (15) 3. Study-Hall (5) 

4. Library (10) 5. Gymnasium (15) 6. Lunchroom (10) 

B. Rooms for School Officials (35) 

I. Offices (10) 2. Teachers' Room (10) 3. Nurses' Room (10) 

4. Janitor's Room (5) 

C. Other Special-Service Rooms (40) 

I. Laboratories (20) 2. Lecture-Rooms (10) 3. Storerooms (5) 

4. Studios (5) 



DETAILED SCORE CARD FOR CITY SCHOOL BUILDINGS 

I. Site 
A. Location: 

1. Accessibility — centrality (present and future), car lines, streets. 

2. Environment: 

a) Physical — gardens, trees, shrubbery, buildings, hills. 

(S — Skyline should not have an angle of more than 30 degrees from base of 
building.) 

b) Social — density of settlement, composition, moral influences. 

c) Protection — ^freedom from noise, dust, danger, malodors. 
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B. Drainage: 

1. Elevation, slope. (S-^rounds shoiild slope away from building and should 
not exceed i in. for every 3 ft.) 

2. Nature of soil — ^residual or artificial, kind, texture, aeration, hydration, surface 
material. 

C. Size and Form: 

Should be large enough and of good shape to allow for proper placing of buildings, 
for 30 sq. ft. of playground per child, and for school garden. 

n. Building 

A. Location: 

1. Orientation — flight, exposure. (S — Southeast, east, southwest, west, and south 
in order.) 

2. Position on site as regards appearance and economy of playgrounds. 

B. External Structure: 

1. Type — ^rectangle, square, inner court, T, H, E, U. 

2. Material. (S — Brick or stone.) 

3. Height — ^number of stories. (S — ^Two stories above basement.) 

4. Roof — type and material. (S — ^Flat, waterproof, suitable for playground, 
proper slope for drainage.) 

5. Entrances: 

a) Number, location width. (S — ^At least two, near stair landings, 11-13 ft, 
wide.) 

b) Steps — niunber, protection from the elements. (S — ^As few as possible, 
unexposed.) 

c) . Vestibules — size, lighting. (S — 11-13 ft. wide, double-swing glass doors, 

and waterproof floors.) 
d) Doors — ^kind, opening, springs, checks, stops. (S — ^3} ft.X8 ft., opening 

outward with panic bolts.) 

6. Aesthetic balance. (S — Simplicity and utility.) 

7. Condition. (S — Should be in good repair.) 

C. Internal Structure: 
I. Stairwa3rs. 

a) Construction — ^kind (box, open, winding), material, tread and riser, nosing, 
width, landing, banister (number, kind, size, stability), soundproofness. 
(S — ^Tread, ii-13 in.; riser, 7 in.; width, 5 ft.; metal banister, li in. dia., 
at least two for each stairway, firmly attached.) 

b) Number and location — ^proximity to exits. (S — ^At least two, landings 
near exits.) 

c) Lighting— natural and artifidaL (S — ^Should be well lighted.) 

d) Sanitation — coves, comers, ledges. (S — Should have sanitary coves and 
be free from dust-catchers.) 
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2. Corridors. 

a) Location. 

b) Constructioii^-material, width, door arrangement, finish (chair rail, picture 
mold, dado). (S— Width 11-13 ft.) 

c) Obstructions— lockers, cases, pedestals. (S— These should not obstruct 
easy passage.) 

3. Basement. 

a) Depth below grade, dampness, areas. (S — ^Depth, 3 ft.; floor and walls 
waterproof.) 

b) Boiler-room, accessibility to fuel-room, exits, ash-lifts. 

c) Fuel-room, size, construction, chute. 

4. Attic, waterproof, heatproof, floor. 

m. Service Systems 

Note. — ^Defects in any service system should be checked against the S3rstem, 
wherever found. 

A. Heaiing and Ventilating System: 

I. Kind of sjrstem — direct, direct-indirect, gravity, plenum, plenum-exhaust. 
3. Installation — ^piping, workmanship, noise, control. (S — ^All piping should be 
insulated.) 

3. Air supply — source, amount, humidification, ducts. (S — From the top of the 
building; humidity 40-60 per cent; 2,000 cu. ft. per hour per pupil, should not 
enter with a velocity greater than 6 ft. per second.) 

4. Distribution — size, arrangement, kind of ducts, pipes, and radiators. (S — 
Single ducts for each room; inlets 8-9 ft. above floor, outlets near floor.) 

B. Fire Protection System: 

1. Apparatus — ^fire hose, extinguishers, water pressure, fire alarms. (S — ^Adequate 
supply on each floor; fire alarms easily accessible, automatic in boiler-room, 
connected with dty fire department.) 

2. Fireproofness: 

a) Building as a whole — crating of underwriters. 

b) Stairwa3rs. (S — ^Encased fireproof stair-wells.) 

c) Boiler- and fuel-rooms. (S — ^Separate fireproof rooms.) 

3. Fire escapes — ^number, location, kind, protection, number of exits. (S — ^In 
non-fireproof buildings there should be at least two fire escapes.) 

4. Electrical work — ^natiure and place of intake, insulation, number and kind of 
outlets, location of switches, meter, cut-out, cabinets. (S — ^Should be installed 
according to rules of underwriters.) 

5. Fire doors — kind, location, operation. (S — ^Automatically dosing.) 

C. Cleaning System: Kind, installation, effidency. (S — ^Vacuimi system.) 

D. Artificial Lighting System: Kind, amount, distribution, number, and location of 
switches, outlets for lanterns, etc. 
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£. Electric Seroke Systems: 

1. Clocks. 

2. Bells and gongs. 

3. Telephones — ^number and location. (S — ^At least one on each floor.) 

F. Water Supply System: Drinking-fountains, baths, lavatories, janitor's supply 
(on each floor) . Installation and sanitation. 

G. ToUet SysUm: 

1. Distribution — ^location, accessibility. (S — ^Most on first floor, others dis- 
tributed.) 

2. Fixtures — seats, urinals, washbowls, sinks, towel and paper holders — size, kind, 
durability, and arrangement. 

3. Adequacy — ^number. (S — i seat for each 15 girb, i seat for each 25 bo3rs, 
I urinal stall for each 10 bo3rs.) 

4. Seclusion — soundproofness, doors. 

$. Sanitation — ^finish, material, workmanship, lighting, ventilating. (S — ^Mate- 
rial — ^not absorbent, non-corrosive.) 

H. Mechanical Service Systems: 

1. Elevators (for buildings of more than four stories) — ^location, fireproofness, 
adequacy. 

2. Book-lifts. 

3. Waste-chutes — ^kind, location, size. (S — Fireproof, outlets dosing auto- 
matically.) 

IV. Classrooms 

A. Location and Connections (to exit, drinking-fountains, toilet). Deduct for base- 
rooms and those above fourth floor without elevators. 

B. Construction and Finish: 

1. Size. (S — ^Per pupil 15 sq. ft. floor space and 200 cu. ft. air space.) 

2. Shape — classroom 24X30X12 ft. 

3. Floors — material, condition (cracks, checks, splinters, loose boards, projecting 
ends), width of boards, soundproofness, cove, baseboard, surface, finish. Stone, 
tile, cement, and other composition floors are bad for class- or study-rooms. 
(S — Should be battleship-linoleimi, or hard wood, durable, well joined, and not 
dust-retaining.) 

4. Walls, ceiling — ^plastering, finish, texture, condition, picture mold, chair rail, 
kind and condition of dado. (S — ^Hard, smooth, non-glass plaster, with cement 
plaster for dado, avoiding grooves and ledges.) 

5. Doors — ^how opened, size, kind, lock, threshold, transom, number of exits. 
(S — ^Doors without thresholds and transoms.) 

6. Closets and bookcases — ^location, size, convenience. 

7. Blackboards — ^kind, length, width, color, chalk rail, height from floor, surface, 
quality, condition, trim. (S — ^Slate, fuU black, on front and side of room, 36-42 
in. wide, height of chalk rail, grades I-II, 24 in.; m-IV, 26 in.; V-VI, 28 in.; 
Vn-Vni, 30 in.; high school, 32-36 in.) 
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8. Color-scheme — ^woodwork, dado, waUs, ceiling, furniture, shades, finish, fix- 
tures. (S — ^Neutral color, buff or green; dado slightly darker than waUs, white 
or cream ceiling; woodwork, furniture, and shades to harmonize in tone; dull, 
smooth finish.) 

C. lUuminaHon: 

1. Glass area — \ to \ area of floor. 

2. Windows — size of mullions, nearness to ceiling, height of sill, kind of glass, 
distance of front window from front wall, orientation, shape. (S — ^From 
pupils' left, unilateral, grouped, ssrmmetrical, as near ceiling as possible, 3} to 
4 ft. from floor, plain glass, mullions not over 12 in. wide. Front windows 
should not come within 5 ft. of front wall; easterly exposure best; rectangular 
in shape.) 

3. Shades — ^kind, material, hanging, adjustment, condition. (S — ^Adjustable 
from center.) 

D. Cloakroom^ Wardrobes: Location, size, convenience, ventilation, finish. (S — ^Ample 
ventilation and accommodation.) 

£. EguipmefU: 

1. Seats and desks — kind, nimiber. (S — ^Adjustable-movable or adjustable; not 
over 42 in niunber.) 

2. Teacher's desk. (S — 'So platform.) 

3. Bulletin boards. 

V. Special Rooms 

A. Large Roam far General Use: 

1. Playroom — ^location, size, accessibility, adaptability, finish. (S — ^Per pupil 
15 sq. ft. floor space and 200 cu. ft. of air space.) 

2. AuditoriTmi: 

a) Location, accessibility. (S — ^Should be on first floor.) 

b) Construction — size, height, seating capacity, floor, acoustics, exits, obstruc- 
tions, gallery (kind, seating capacity, location), light and nature of stage, 
finish, ornamentation. (S — ^For 80 ft. length on flat floor, stage should be 
3 ft. 8 in. high; on dish floor, 3 ft.) 

c) AiudUaries — dressing-rooms, curtain, setting, seats (kind, arrangement). 

3. Study-hall — ^location, size, accessibility (especially to library), adaptability, 
finish. 

4. Library — ^location, size, accessibility, form and arrangement of stacks. 

5. Gjrmnasium : 

a) Location — accessibility, segregation of sexes. 

b) Construction — size, floor, track, gallery, soundproofness, finish. (S — 
Height 22-25 ft. Length and width should relate as 3 to 2.) 

c) Auxiliaries — blockers, showers, dressing-rooms (nimiber, kind, location, con- 
venience, condition.) 

6. Lunchroom — ^location, accessibility, size, adaptability, arrangement, finish, 
sanitation. 
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B. Rooms for School Officials: 

1. Offices — ^location, size, adaptability, finish; waiting-room (ditto). 

2. Teachers' room — location, size, toilet facilities, equipment, finish. (S — ^Equip- 
ped with chairs, couch, gas or electric plate.) 

3. Nurses' room — ^location, size, equipment and toilet facilities (including bath) 
adaptability, sanitation, finish. 

4. Janitor's room — ^location, size, convenience. 

C. Other Special-Service Rooms: 

1. Laboratories: 

Note. — ^Indude all facilities for chemistry, physics, biology, ph3rsiography, 
commercial work, household and industrial arts. 

a) Kind, location, size, adaptability. (S — ^Depends on number of pupils to be 
accommodated. A room 30X40 ft. will accommodate 25 pupils.) 

b) Construction — ^plumbing, storerooms, cabinets, finish. 

2. Lecture-room — ^location, size, seating capacity, plumbing facilities, accessibility, 
fixed furniture (nimiber, kind, arrangement). 

3. Supply- and storerooms — ^location, size, adaptability. 

4. Studios — ^kind, location, size, and adaptability. 

Note. — ^Lidude drawing-, art,- and music-rooms. 
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CHAPTER IV 
COMPLETION TESTS FOR PUBLIC-SCHOOL USE 



M. R. TRABUE 
Instructor in Educational Administration, Teachers College, 

Columbia University 



Many of the tests upon which psychologists depend for their knowl- 
edge of an individual's mental characteristics are of such a nature that 
it is almost impossible to make extended use of them in the schoolroom. 
There are other very reliable psychological tests, however, which may be 
adapted to schoolroom use with comparatively few changes. One of 
these is the completion test, which psychologists have come to regard 
as an unusually good test of ability to think about words and language 
forms. In view of the fact that so much of the child's school work is 
dependent upon his ability to read and interpret printed words, it has 
seemed worth while to the writer to make such changes in the form of the 
completion test as will make it available for general use in schools.' 

The scale shown below will serve as an example of the proposed new 
completion-test forms. It is believed that these new forms will be found 
very helpful to school officers in measuring the abilities of children and in 
classifying them accordingly. 

The foregoing form is designed to meet the two or three most serious 
obstacles which heretofore have confronted the school ^officer who wished 
to employ the completion test in his school system. In the first place, 
the forms commonly used by the psychologists cannot be employed in the 
middle and lower grades of the elementary school because they are too 
difficult. Ebbinghaus, who was the first to employ the completion-test 
method, used mutilated paragraphs. In this respect he has been fol- 
lowed very closely by later investigators, and iii^lmost every instance 
the incomplete paragraphs have been too difficult for practical use 
with elementary school pupils. I have attempted, in preparing forms 
for school children, to use the sentence, rather man the paragraph, 

> M. R. Trabue, "Completion-Test Language Scales," Teachers College CaniribU' 
Hons to Education, No. 77, New York, 1915. 
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as the unit of thought. I have found it possible to begin a test with 
sentences so simple that a large majority of the second-grade pupils are 
able to complete them correctly, and to finish the test with sentences 
so difficult that only a small percentage of the Freshmen in college com- 
plete them. 

Write only one word on each blank 
Time Limit: Seven minutes 

Name 

Trabue Language Scale B 

I. We like good bo3rs girls. 

6. The is barking at the cat. 

8. The stars and the will shine tonight. 

22. Time often more valuable money. 

23. The poor baby as if it were sick. 

31. She if she will. 

35. Brothers and sisters alwa3rs to help 

other and should quarrel. 

38 weather usually a good effect 

one's spirits. 

48. It is very annoying to '. tooth-ache, 

often comes at the most time imaginable. 

54. To friends is always the it 

takes. 

A second difficulty with previous completion-test forms arises from 
the fact that we do not know the relative values of the various commonly 
used paragraphs, which makes it practically impossible to measure 
progress from year to year or from grade to grade. Professor Whipple 
emphasizes this point, as follows: ''Since the elision of a single letter 
may, in some circumstances, very considerably increase the difficulty of 
the test, it follows that, without extensive preliminary trials, it is well- 
nigh impossible to prepare a series of texts of equivalent difficulty, or 
to insure that the several sections within a given text present equivalent 
difficulty."' 

This objection has been met by actually trying the incomplete 
sentences upon thousands of public-school children and discovering 
from the results just how difficult each sentence is for each class of 
children, and for all children together. From the results thus obtained, 

I G. M. Whipple, Manual of Mental and Physical Tests, Part n (1915), p. 284. 
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four approximately equal scales have been derived (Scale B, shown 
above, being one of the four), each scale consisting of ten sentences, which 
are arranged in the order of their difficulty from simple to hard. By 
measiuing ability at the beginning of a year with one scale and then at 
the beginning of the next year with an equivalent scale, it is possible by 
subtracting the first result from the second to determine the amount of 
change effected in a class or in a child during a year. 

A third difficulty with the paragraph form of the completion test 
is foimd in the scoring. Ebbinghaus scored according to the number of 
syllables correctly supplied, but this method is inadequate, for some 
syllables are ten times as hard to supply as others. Later investigators 
have estimated the quality of the completed paragraphs as wholes, giving 
IOC per cent for a perfectly completed paragraph, 50 per cent "if the 
inserted words make a well-connected story, but related in only a 
moderate degree to the thought that should have been given," and no 
credit at all for words which are "purely literary invention, having no 
connection with the thought given by the printed words." 

It will readily be seen that very careful consideration and judgment 
are required if one is to assign accurate and comparable scores in the 
foregoing manner. Even trained psychologists have difficulty in agree- 
ing just how much a given completion is worth. Teachers and school 
administrators are usually too busy with other school problems to spend 
much time in such tiresome mental labor as is required to assign scores to 
partially completed paragraphs. 

After making an attempt to distinguish six grades of quality (5-4-3- 
2-1-0) in the completion of a sentence,' the writer foimd that practically 
nothing was lost by simplifying the scoring still further, giving 2 points 
credit for each perfectly completed sentence, i point for each sentence 
completed with only a slight imperfection, and o for any sentence omitted 
or imperfectly completed. It is infinitely easier and quicker to say that 
a sentence is "right," or that it is almost "right," than it is to decide 
that a partially completed paragraph is worth 78 per cent of a perfectly 
completed paragraph. The writer has also published in the appendix 
of his report the detailed scheme by which each individual sentence was 
scored, in order that teachers or administrators who do not wish to be 

> J. L. Stenqtiist, £. L. Thomdike, and M. R. Trabue, ''The Intellectual Status of 
Children Who Are PubHc Charges," Archives of Psychology y No. 33, September, 1915, 
pp. 13-19. 
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bothered with the making of judgments as to whether a sentence is right 
or wrong may have before them very objectively just what has been 
called "right" and what has been called "wrong." 

The writer is rather firmly convinced that ability to perform mental 
tasks can be measured more adequately by a graded series of perform- 
ances to be done in a given time than by any other scheme. The 
measurement of physical ability to lift weights at arm's length may be 
taken as an analogy. If we had a series of ten weights, ranging from 20 
to 200 poimds by steps of 20 poimds between consecutive weights, as 
represented in Fig. i, we might measure a boy's ability by having him 
begin at the lightest of the series and at arm's length lift in their order 
to the level of his shoulder as many of the weights as possible. In order 
to make the analogy with Scale 6 complete, we should have to give 2 

®®®(|0)(J00)(ll0)(J4^ 

Fig. I. — ^Representing a series of graduated weights. 

points credit for each weight lifted to a level with his shoulders, and 
I point for each weight which was lifted "almost but not quite" to the 
shoulder level within a time-limit of seven minutes. 

With the older completion-test forms the analogous measurement 
would be as follows: give the individual the 200-poimd weight and see 
how nearly to the shoulder level he can raise it in ten minutes. It is 
clear at once that a test arranged on such a plan could be used for only a 
short fraction of the total range of ability, and that scores assigned by 
different individuals for the same quality of performance would vary 
considerably. 

With certain commonly used tests in arithmetic the analogous 
measurement would be somewhat as follows: give the boy a large number 
of loo-poimd weights and see how many of them he can at arm's length 
lift to shoulder level in four minutes. It is evident at once that a large 
amoimt of ability must be present before such a test can begin to measure, 
and that speed is practically the only element of ability measured. Since 
speed is desirable, however, it is highly worth while to measure it, 
although we must be careful not to take a measurement of speed as a 
sufficient index of ability. 
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In axranging the language scales, the writer has assumed that older 
children will not only be able to do the same tasks more rapidly and 
more perfectly than yoimger children, but that the older children will 
also be able to accomplish perfectly tasks which the yoimger children 
could not begin to do. The results from twelve or thirteen thousand 
children, upon whom these sentences have been tried, seem to support 
this assimiption in every respect. 

The unit of difficulty used in constructing Language Scales 6, C, D, 
and £ is the P.E., or median deviation from the median of a school- 
grade distribution of ability, assmning the curve of distribution for 
ability in any given grade to be "normal" in shape and equivalent in 
range to the range of any other grade distribution. The reasons for 
making these assumptions and using this measure of the variability of a 

5«ntcnc« (to, 
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P.E. Scale 

Fig. 2. — ^Linear projection of Language Scale B. 

grade as the unit need not be discussed here. It is worth while to remem- 
ber, however, that if we take any two groups, selected by the same or by 
equally capable judges as representing two different degrees of the same 
sort of ability, these two groups are very likely to be distributed "nor- 
mally" in each case and the variability of one group will probably 
be very nearly equal to the variability of the other. In other words, 
approximately as many errors of judgment are made in selecting one 
group as in selecting the other, and in each group approximately as 
many are overestimated as are underestimated, errors in either direction 
being much more frequently small than large. In brief, the P.E. is a 
convenient unit which has approximately the same value in every grade 
and may therefore be used to measure the distance between grades and 
the difficulty of tests for all grades. 

On a P.E. scale above an arbitrary zero point, the location of each 
sentence of Language Scale 6 is as represented in Fig. 2. It will be 
observed that the intervals between sentences are not exactly i P.E. in 
each case, but for practical purposes they are near enough. The improve- 
ment made by a person who was at first able to complete only two 
sentences but is now able to complete four is at least in a very real sense 
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equal to the improvement made by the person who was at first able to 
complete only seven sentences but is now able to complete nine. 

As yet the writer has not had time to use the new scales very exten- 
sively in their present form, although the sentences of which they are 
composed have been thoroughly tested in other combinations of sen- 
tences. Language Scale A,' which is so poorly graded as not to be 
worthy of the name "scale," has nevertheless revealed some of the 
possible values of the completion test in school procedure. 

Scale A was composed of 24 sentences, so that with 2 points credit 
for each perfectly completed sentence the maximum score possible 
would be 48 points. The median score and the range of the middle 
50 per cent of the scores are shown in Table I for those pupils of the 
elementary grades who were tested with Scale A. 

TABLE I 
Scores of Elementary-Grade Pxtpils on Language Scale A 





School Grade 




II 


ni 


IV 


V 


VI 


VII 


vin 


No. tested 

Median score 

25 percentile 

75 percentile 


1318 

459 
2.40 

6.57 


1437 

8.99 

6.22 

13.04 


1463 

14.33 
10.28 

18.60 


1507 
18.39 

14.97 

22.02 


1454 
21.92 

18.14 
25.36 


1456 
25.27 
21.58 
29.08 


1427 
28.06 

24.34 
32.42 



In connection with Table I it is worth while to consider Table 11, 
which shows the median scores of twelve-year-old boys according to the 
school grade in which they are foimd. 



TABLE n 
Median Scores of Twelve-Year-Old Boys on Language Scale A 





School Grade 




lU 


IV 


V 


VI 


VU 


vni 


No. tested 


22 
10.5 


62 
12.9 


155 
16.3 


269 

21.6 


217 
24.7 


76 
29.8 


Median score 



' M. R. Trabue, "Some Results of a Graded Series of Completion Tests/' School 
and Society (April 10, 1915), 537-40. 
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It would seem from Tables I and 11 that the ability measured by 
these completion-test sentences is related rather closely to the ability 
which teachers consider when promoting pupils to higher grades. Table 
ni, showing the median scores of sixth-grade boys according to their 

TABLE in 
Median ScoitES of Sixth-Grade Boys on Language Scale A 





Agb 




lO 


zz 


Z2 


13 


14 


IS 


z6 


No. tested 


70 
23 -4 


201 

22.6 


243 
21.9 


164 
21. 1 


74. 
18.9 


30 
17.6 


7 
13.3 


Median score. 





ages, is interesting in this connection. This table furnishes evidence 
of a fact which needs to be emphasized. Teachers tend to retard the 
bright yoimg chaps because they are "too young" and to promote the 
dull old fellows because they are "too old" for the grade. Possibly 
the most serious retardation problems in our American school systems 
arise from our lack of adequate provision for the exceptionally bright 
young children. 

Scale A was given in a niunber of intermediate schools with interest- 
ing results. At Decatur, Illinois, four classes of Grade VIIA were 
tested. The median scores were as follows: 





Class 




VIIA« 


VIIA« 


vua« 


VIIA4 


No. pupils 

Median 


23 
28.3 


22 
26.9 


20 
25. 5 


21 
23.7 



After this result was noticed, I was interested to find that each pupil is 
classified, on entering VIIA, according to the judgment of previous 
teachers as to his general ability to do school work, those of greatest 
ability being put in VIIA', the next best group in VIIA*, and so on. 

In Grand Rapids, Michigan, those pupils in the eighth grade whose 
superior scholarship has been proved are allowed to take up the study of 
Latin. The median score of the 28 pupils in the Latin group was 34.0, 
with only one score as low as 27, while the median score of the 71 other 
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pupils in the same grade of that school was 29.8, with two scores of 17. 
Evidently the ability required to make high scores on Language Scale A 
is rather closely related to the quality for which teachers look when they 
attempt to select their brightest pupils for special work. 

In view of the fact that ability to complete incomplete sentences 
is so obviously dependent upon ability to read and interpret printed 
words, it is not surprising to find that home training and nationality 
show an appreciable correlation with ability in these language scales. 
Three graduating classes in the elementary schools of Kansas City 
were measured on Language Scale A, with the following results: 



No. pupils, 
Median. . . 



School 



Hyde Park 



44 
33.4 



Whittier 



42 
31.3 



Hamilton 



29 
27.3 



The Hyde Park and Whittier schools are distinctly American, the first 
being in the best residence section of the city and the second being in a 
respectable middle-class district. The Hamilton School, however, 
is in a foreign district, one block from the Swope Settlement. 

The writer f oimd a similar situation in Bayonne, New Jersey. Three 
VIA classes were measured on Scale A, with the following results: 



No. pupils. 
Median. . . 



School 



Mann 



32 
23.6 



Vroom 



37 
20.4 



Lincoln 



39 
19.2 



The Mann School is largely American, the Vroom largely Jewish, and the 
Lincoln largely Slavonic in student population. 

The completion test is not proposed as a substitute for the judgment 
of teachers in promoting pupils, but rather as an aid to it. Employing 
one of these scales will call attention to those children who have imusual 
ability to imderstand and interpret printed words and phrases. These 
unusual cases may then be investigated more carefully and such read- 
justments made as will allow these children to work imder the most 
favorable conditions. 



PART II 

APPLICATION OF SCALES AND UNITS OF MEASUREMENT IN EDU- 
CATIONAL SUPERVISION AND ADMINISTRATION 



CHAPTER V 

WORK OF THE DEPARTMENT OF EDUCATIONAL INVESTIGATION 
AND MEASUREMENT, BOSTON, MASSACHUSETTS 



FRANK W. BALLOU 
Department of Educational Investigation and Measurement, Boston, Massachusetts 



The three phases of the work of the Department of Educational 
Investigation and Measurement, which will be described in order below, 
are: (A) measurement of educational results; (6) supervision of a 
revision of the elementary course of study; (C) the organization of a 
plan for the promotion of teachers on merit. 

A. MEASUKEMENT OF EDUCATIONAL RESULTS 

I. ArUhmetic. — The Coiurtis standard research tests in the four 
fimdamentals were first given in Boston in October, 191 2, by Mr. 
Coiurtis himself. Later they were given by others and have been con- 
tinued to be given by this department. Their introduction into the 
Boston schools has been gradual, beginning with 21 districts in October, 
1912, and covering the 70 elementary districts in May, 1915. 

The tests have resulted as follows: 

1. They have made possible the establishment of objective stand- 
ards of achievement for Grades IV-Vin in addition, subtraction, multi- 
plication, and division. These standards are based on the median score 
attained by large groups of pupils, and represent, therefore, the minimal 
achievement of at least 50 per cent of the children tested. These stand- 
ards are shown in Table I. 

2. These tests have shown the relative standing of each school, of 
each class, and of each pupil, in the 70 elementary school districts 
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tested, thereby providing the administrative officers with information 
a§ to the conditions which need unproving. 

3. They have revealed the inejffectiveness of the present general class 
drill in arithmetic on the four fmidamentals, by showing that approxi- 
mately one-third of the class gets more drill than it needs, another third 
makes fair progress, and the other third not only does not improve but, 
in many cases, actually loses in ability. 

TABLE I 





Tdcb Allowed 


Grades 


Addition, 
8 Minutes 


Subtraction, 
4 Minutes 


Multiplication, 
6 Minutes 


Divfdott, 
8 Minutes 




Attempts 


Rights 


Attempts 


Rights 


Attempts 


Rights 


Attempts 


Rights 


IV 


8 

9 

10 

II 
12 


6 

7 
8 

9 
II 


8 

9 
10 

II 

12 


6 

7 
8 

9 

II 


6 

7 

9 
10 

II 


4 

5 

7 
8 

10 


4 
6 

8 

10 

12 


2 


V 


4 
6 


VI 


vn 


8 


vin 


II 







4. They have demonstrated the need of drilling pupils in those 
four fimdamentals in which they are deficient. To this end, a large 
number of the 70 elementary school districts have introduced several 
kinds of practice material in arithmetic, the relative merits of which 
are being studied by teachers and masters with a view to using that 
which proves most effective. 

II. Spelling. — ^Proceeding from the fact that an eighth-grade pupil 
probably uses not more than twenty-five himdred words in his writing, 
whereas the spellers in common use contain from ten to fifteen thousand 
words, the department has worked as follows: 

1. With the aid of many teachers minimal and supplementary lists 
of alleged difficult words have been prepared for each of the eight grades. 
These lists were placed in the hands of each teacher in the elementary 
schools, with the suggestion that the minimal list be emphasized in the 
spelling instruction (School Document No. 8, 1914). 

2. The intention is by no means to limit the instruction to the words 
which are at present contained in the minimal list, but it is to make sure 
that the child learns to spell the words which he actually uses in his 
voluntary writing. 
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3. A test was given in May, 1915, to all grades above the second, 
for the purpose of determining the relative degree of difficulty of the 
words in the minimal lists. 

4. As a result of that test each word is accompanied by a percent- 
age, which indicates the number of pupils that spelled the word correctly. 
In this way each teacher is furnished with a list of alleged difficult 
words, together with information as to their relative degree of difficulty, 
thus making it possible for a teacher to place the emphasis in her instruc- 
tion on the more difficult words {School Documentj No. jo, 1915)- 

5. A further result of this test is to furnish each teacher with a 
standard by which she may judge whether her class is above or below 
the general standard for the city. If, for instance, a word is indicated 
as having been spelled correctly by 90 per cent of the children of the 
city, a teacher knows that if more than four out of the forty pupils in 
her class misspelled that word her class is below the standard ability of 
Boston children to spell that word. 

6. A study has been made of the various lists of words that have 
recently been prepared as a result of scientific investigation, and the 
resulting list has been supplied to the teachers. It is the ultimate 
intention to make selections of words from this list to be added to the 
minimal lists imtil the minimal lists contain practically all of the words 
which are within the writing vocabularies of the normal pupils of each 
grade. 

m. English. — ^Before the Department of Educational Investigation 
and Measurement was organized a Committee on Standards in English 
had been at work for some time and had set up some tentative require- 
ments in English which the committee felt ought to be met by every 
pupil who graduates from the elementary schools. These requirements 
were approved by the Board of Superintendents and thus became 
authoritative standards. The requirements are as follows: Every 
graduate should be able: 

1. To copy twelve lines of simple prose or poetry, and a bill of at 
least seven items. (Copying is not an end in itself, but a means to an 
end. The pupil should be made to see that accuracy in arithmetic, 
language, and other subjects may depend largely on accuracy in 
copymg.) 

2. To take down from dictation a passage of simple prose. (The 
purpose of dictation is to test language forms, pimctuation, and spelling 
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already taught. It should never be used as a method of teachmg. It 
should succeed and not precede a teaching lesson.) 

3. To write from simple directions a friendly letter or an applica- 
tion for a position. (The letter is to be the pupil's own work, but he 
may be allowed to make corrections and to re-write. There should be 
no corrections by the teacher.) 

4. To write within a half-hour a simple, original composition of not 
less than one page of letter paper, with every sentence grammatically 
complete. The pupil may make revisions, including interlinear cor- 
rections, but must not re-write. 

In this composition the total number of serious errors in granmiar, 
spelling, and punctuation should not exceed five — such errors, for 
example, as "I seen," "we was," "had wrote," "he try" for "he tried," 
"a women," the use of "they" for "there," "there" for "their," "to" 
for "too"; the misspelling of such common words as "Wednesday," 
"February," "eighth," "which," "stopped," "nineteen," "minute," 
"father," "mother," "English"; the omission of the period at the end 
of a sentence. 

5. To recognize the parts of speech in their common uses; to explain 
the construction of words and phrases in a simple sentence containing not 
more than one phrase modifier in the subject and one phrase modifier 
in the predicate; to have a practical imderstanding of the uses to which 
the dependent clause of a complex sentence can be put — ^whether it be 
to serve as noun, adjective, or adverb; to know the principal parts of 
regular verbs and of the common irregular verbs, and their tense forms 
through the indicative mood. 

6. To read at sight with readiness and good expression simple prose 
as difficult as Littte Men or Hans Brinker. 

7. To quote either oraUy or in writing fifty lines, not necessarily 
consecutive, of classic prose or poetry. (The pupil should look upon 
this not merely as something to be expected of him in the high school 
but also as a part of his equipment for life.) 

8. To stand before the class and talk clearly on some subject of 
personal, school, or public interest. 

The Committee on Standards in English is co-operating with the 
department in putting these requirements into ejffect. To this end, 
the department and the committee caused two tests to be given in 
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November, 1914, to 4,944 pupils in the first-year classes in the high 
schools. These tests were in accurate copying and in written memory 
work. \ 

1. The test in accurate copying was to discover what degree of 
accuracy should be expected of pupils when they are asked to copy 
fifteen lines of prose in fifteen minutes. 

2. The test in written memory work was to find out how well pupils 
remember the fifty lines of classic prose and poetry which the course of 
study requires that they shall have committed to memory before grad- 
uating from the elementary schools. 

3. As a result of the test in accurate copying it has been found that 
boys will copy fifteen and one-half lines (4) inches long) of prose in 
fifteen minutes, with 50 per cent of the pupils making less than five 
errors of any kind (spelling, capitalization, pimctuation, words omitted, 
words added, wrong words used, misspelled words, undotted t 's and 
uncrossed ^'s). 

4. The same test shows that the girls will copy more than sixteen 
lines in fifteen minutes, and that 50 per cent of the girls will make less 
than three errors of any kind. 

5. By giving a standard test imder controlled conditions, it will be 
possible to give a similar test at some future date and determine whether 
or not improvement has been made. 

IV. Geography. — ^In co-operation with the head of the Department 
of Geography in the normal school the department has given two tests 
to pupils in the eighth grade to determine: 

1. How well pupils in the eighth grade remember the geography 
which they were taught in the earlier grades. 

2. What ability pupils have to reason about geographical data. 

3. Whether mereplace-geographyisbeingoveremphasized in teaching. 

V. Penmanship. — ^The quality of the handwriting of elementary- 
school graduates has been studied as follows: 

1. Six-himdred specimen papers were selected from the 4,944 
papers written in the test in accurate copying. The pupils were not 
aware that their handwriting was to be examined, hence they probably 
wrote in a natural, imrestrained manner. 

2. These 600 specimen papers were rated according to the Ayres' 
Scale for Adult Handwriting, using only the specimens in the scale 
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under 90, 70, 50, and 30. Specimens poorer than the 30 spedmen in 
the scale were rated 10. 

3. The specimens were rated by a committee of six teachers who 
are superior teachers of handwriting. Each paper was rated by three 
persons. 

4. The final rating of a paper was determined in the following 
manner: Where two or more persons agreed^ that rating was given the 
specimen; where no two agreed, the middle rating was assigned. 

5. A further study is being made of the merits and defects exhibited 
in these 600 specimens and a report will be printed and distributed 
among the teachers. 

B. REVISION OP THE ELEMENTARY COURSE OF STUDY 

In co-operation with two of the assistant superintendents the depart- 
ment is supervising the revision of the course of study in the elementary 
schools. In order to assist the teacher to economize her time and 
energy by the adoption of more definite purposes in teaching, these 
special featiures are being introduced into the course. 

1. A concise, definite statement of the aims to be accomplished in 
the teaching of each subject in each grade. 

2. A statement of the irreducible minimal essentials in each subject 
in each grade. 

3. A definition of the objective standards of achievement in various 
subjects as far as they have been worked out. 

This revision is being made with the co-operation of about 40 com- 
mittees, including 359 different teachers, working on the following sub- 
jects: arithmetic, reading, stories and literature, spelling, grammar, 
composition, dictation, geography, and history. 

This utilization of the knowledge, ability, and experience of the 
teachers will be followed by further professional educational advice from 
principals and superintendents. This method of course of study revision 
has the advantage of building up a practical course of study based on 
classroom experience, of securing the sympathetic imderstanding by the 
teacher of the course when it is adopted, and of affording helpful stimulus 
and proper encouragement to the teaching staff which must^ follow 
from such professional recognition. 
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C. ORGANIZATION OF A PLAN FOR PROMOTION OF TEACHERS ON MERIT 

Inasmuch as the higher positions in the school service must be filled 
by the superintendent when vacancies occur, the department has pro- 
ceeded on the assumption that any plan of promotion, honestly admin- 
istered, is better than no plan at all. The need of a systematic plan is 
seen in the following phases of the conditions in the Boston school 
S3rstem. 

1. The size of the public-school system, with its nearly two thou- 
sand elementary and over five himdred high-school teachers, makes it 
impossible for the superintendent to know the work of the teachers 
except indirectly. 

2. The variety of ranks both in the elementary and in the high 
schools makes relatively a large number of promotions within the 
service. 

3. The large number of candidates who hold certificates making 
them eligible for promotion makes necessary some further plan for 
determining their relative professional qualifications. 

The scope and method of the work of the department to formulate 
a plan will be illustrated by the following brief statements: 

1. Several conferences have been held with sub-masters and master's 
assistants, because they are among those most interested in a plan of 
promotion on merit. Among other things, it was agreed, subject to the 
necessary official approval, that (a) the sub-master in the school where 
the vacancy occurs should be given first consideration for appointment; 
{b) other qualifications being ^qual, that sub-master in the service 
longest as sub-master should be appointed first; {c) ratings of teaching 
ability and estimates of probable future success should be secured from 
(i) assistant superintendents, (ii) masters of schools, (iii) director of 
promotion and educational measurement. 

2. At a conference with the Board of Superintendents a common 
basis for securing discriminating and comparable ratings was agreed on. 

3. A comprehensive basis for judging merit has been prepared by the 
department after a study of the available plans of rating teachers in 
cities throughout the coimtry (see forms 264, 265, 266, and 267). 

4. From April, 1914, when the department began work, to Jime 
I, 1915, the following higher positions have been filled in accordance 
with the proposed plan, in so far as it has been worked out at the present 
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time. All appointments to higher positions between these dates have 
been made according to the merit system. 

In elementary schools: 

First assistant, grammar Women i 

First assistant in charge Women 7 

Master's assistant Women 5 

Sub-master Men 5 

Master <„, 

^Women i 

In high schools: 

Master, head of department Men i 

Head master Men 4 



CHAPTER VI 

THE APPLICATION OF STANDARD MEASUREMENTS TO SCHOOL 

ADMINISTRATION 



D. C. BLISS 
Superintendent of Schools, Montdair, New Jersey 



A study of the educational literature of recent years reveals a steadily 
increasing interest in the possibility of the application of standard tests 
and measurements to the problems of school administration. Many 
prominent educators honestly question the value of such tests, because 
they feel that the most important elements in the mental and moral 
development of pupils are of an intangible character which can by no 
possibility be confined in terms of measurement. No one would dispute 
the fact that human life is a deeper and more complicated subject than 
can be probed by quantitative tests; nevertheless, when the more subtle 
components have been excluded, there remain some essential elements 
in education which are purely objective, and that these can be measured 
with reasonable exactness there is no reason to doubt. Because some 
things of supreme importance cannot be included in this category is no 
valid argument for rejecting the entire plan. We measure a man in 
terms of achievement; to apply to the schools the same test, the ability 
to produce results, is only logical and reasonable. The spiritual side of 
education is real and in all probability defies measurement, but a com- 
plete education includes elements other than the spiritual, and so far 
as they are present they can be measured. If they are so vague and 
indefinite as to escape measurement, their existence may well be doubted. 
The more clearly the objective results of education are understood, the 
greater the appreciation of the spiritual elements in the child's training. 
To reassure those who fed that any effort to arrive at a definite knowl- 
edge of educational values carries with it the danger of obtruding com- 
mercial methods into the region of things of the spirit, the well-proved 
truth may be reiterated here: the more clearly the objective results of 
education are understood the greater is the appreciation of the fact that 
unless all three natures, physical, mental, and spiritual, are being 
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definitely led toward their fulfilment, no system of child-training is even 
approaching the adequate performance of its function. 

The mechanical application of standard tests with the resultant 
accumulation of medians, graphs, and charts is in itself a futile thing. 
Only as these tests are informed and controlled by a trained and sym- 
pathetic mind using the facts revealed as the basis of a constructive 
policy for future work do they find their justification. They show to a 
superintendent the extent to which his plans have been correctly inter- 
preted and put into operation, and they furnish him with a sound basis 
for necessary changes, whether in the way of revision or of the introduc- 
tion of new methods. 

Because of the increasingly heavy demands upon the public schools, 
economy of time and of energy in every direction has become a necessity. 
Consider the relatively simple subject of penmanship. Once a pupil's 
handwriting was acceptable if the letters were well formed and the lines 
even, and the method of achieving this result was left largely to nature, 
or, when she had failed in the bestowal of the necessary gift, to the 
child's dogged patience in drawing over and over something resembling 
the copperplate sentence at the top of his writing-book. Now, writing 
has been differentiated from drawing, and every motion has been ana- 
lyzed; imaccustomed muscles must be trained and co-ordination estab- 
lished; form must still be maintained, but the emphasis has been 
shifted to power; legibility must be accompanied by speed and a degree 
of freedom which makes it possible to continue the rapid, even movement 
for long stretches of time without fatigue. The problem before the 
school is how to meet these entirely reasonable demands without imduly 
prolonging the amount of time which may fairly be assigned to the 
subject. To this end the department of superintendence must know 
immistakably every point of success or failure in the penmanship teach- 
ing and drill throughout the whole school system, that waste of time and 
effort may be eliminated. By what method shall the facts be ascer- 
tained most quickly and effectively ? 

Spelling is another comparatively simple subject, with a compara- 
tively short time allotted to it in the school program. Questions like 
these face the teacher and the superintendent: Is the method in use 
producing accuracy ? Is drill being wasted upon unusual words which 
will in all probability never find a permanent place in the child's vocabu- 
lary ? Is drill on many words being carried beyond the point necessary 
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for fixing them in the memory? Has every child a limited working 
vocabulary which it is impossible for him to spell incorrectly ? 

Unsupported opinion can no longer be brought forward to decide, 
even in ciunulative fashion, these and manifold other points which arise. 
What twenty eminent educators think as to the efficacy of a certain 
method gives way before the facts which careful investigation shows. 
Valid conclusions can be based only upon the results of accurate tests 
applied to large groups and continued for a sufficient length of time to 
eliminate possible error. If, as has already been said, such tests result 
only in the mere accumulation of educational statistics, they fail to justify ' 
the attendant expenditure of time and energy. They must surely 
function in an improvement in schoolroom practice or they are worse 
than useless. Unfortimately, it is precisely at this essential point that 
the vitality which should inform the laboriously acquired statistics is 
allowed to escape, leaving an inert mass of figures to show that someone 
has been busily and vaguely occupied about something. In education, 
as in every other department of life, the demand is not "Be busy about 
something," but "Be busy to some purpose." 

So simple material as the relationship of "age and grade" should be 
carefully interpreted, and the inferences drawn from it should be a 
factor in shaping the school policies for the ensuing year. Percent- 
age of promotion, "mortality" both in the grades and in the high 
school, the number of pupils accelerated or retarded, and other data 
of this character furnish evidence for a diagnosis of the health of the 
school body. 

As a case in point may be cited the age-and-grade table of the 
Montdair, New Jersey, schools for September, 1912, which showed 
23 per cent of retardation. Since this seemed too large for such a com- 
munity, the superintendent and principals met for a discussion of plans 
looking toward the improvement of the situation. No radical steps 
were taken, but the schools were fully aroused to their responsibility for 
the excessive number of repeaters, with the result that the needs of 
individual children were given more careful consideration and a greater 
degree of flexibility was infused into school administration. In Sep- 
tember of the following year figures were compiled on the same basis and 
the totals, which showed a decided improvement, formed the subject 
of another discussion. Four years of this policy have reduced the 
percentage of retardation almost 50 per cent. 
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The same general plan for determining values can be applied to such 
questions as the wisdom of the establishment of open-window classes, 
which, it may be said in passing, should be distinguished from the open- 
air classes — a wholly different problem. The argument in favor of 
open-window classes seems faultless. Fresh air is essential to health; it 
has proved effective as a healing agent in cases of tuberculosis. Anaemic 
children are benefited by open-air rooms. The inference is that healthy 
children will show a still greater improvement, owing to their better 
ph3rsical status. The theory seems flawless, but we need to assure our- 
selves that the facts accord with the theory, and the only way to deter- 
mine this is to test it. One test is to weigh the children of the open- 
window class at certain intervals and then compare the change in weights 
with the change in weights of an equal number of children who are in a 
classroom of the usual t3rpe. The chances are that a superintendent 
who has before him such a record as is shown in Chart II will hesitate 
before extending the plan to his entire school system. Especially will 
this be true if other tests of a different character point to the same 
conclusion. 

In dealing with subnormal pupils the opinion generally prevails that 
they should be given a form of education in which the manual arts pre- 
dominate. It is also believed that defective children who seem to learn 
readily and are able to recite fluently are doing it in parrot-like fashion 
and that even this seeming facility will not long persist, that it is simply 
a case of learning something today and forgetting it tomorrow. Obvi- 
ously, it is of great importance to the teacher to know whether this 
assumption is true of the individual pupils in her care, or whether she 
may stress the academic phase of her work with some hope of making 
an enduring impression. Only by testing the individual pupils is she 
able to determine the character of the training suited to each. 

The possibilities of the standard scale for such children are shown 
by the records in penmanship and arithmetic of a subnormal class last 
year. A local scale, based upon that of Dr. Thomdike, was used to 
measure the quality of the handwriting of all members of the class, and 
this formal rating was made once in two months. The arithmetic scale 
consisted of ten problems in fimdamental operations. A definite time- 
limit was fixed for the solution of these problems. No credit was given 
for incorrect results or omitted examples. The records made by a sub- 
normal pupil in the two subjects appear in Charts III and IV. 
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Chabt n, — Gains and bases in weight of open-wiDdow class and of contnj class 
at Montdmr, New Jersey. (The fiist column in each time group represents the <^>eii~ 
window class, the second the control class. The entire height of the columns shows 
weight gain whQe the white portion iec(»ds weight loss. Thus, from November to 
December the pupils of the open-window class gained 33 lbs. 5 oz. and lost 6 lbs. 4 oz., 
making a net gain of 17 lbs. i oz., which b shown by the blackening of the upper 
portion of the columns. Durmg the same period the pupils of the control class 
gained 23 lbs. g oz., and lost i lb. 9 oz., leaving a net f^in of 3 3 lbs. In every time 
group the contrcd class showed a greatei net gain than the t^en-window class.) 
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Chast m. — ^Performance in handwriting of a subnormal pupil. (The quality of 
the handwriting is indicated by the length of the hatched oblong and also by the 
digit at the right. The improvement is steady from September to June.) 
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Chakt IV. — ^Performance in arithmetic of a subnormal pupil. (The figure at 
the right shows the percentage of correct answers.) 



76 



THE FIFTEENTH YEARBOOK 



In the purely mechanical process of writing there would seem to be 
no doubt that this pupil benefitted directly from the teaching. In arith- 
metic the progress is not so evident. 

The fact that the arithmetic test was confined to examples in f imda- 
mental operations of the same degree of difiiculty made the tests prac- 
tically uniform. It is very doubtful if a pupil whose record fluctuates 
to the extent indicated above receives any permanent value from such 
exercises. Similar charts made of every pupil in the class showed the 
same general tendency; improvement in penmanship was fairly constant, 
while in arithmetic frequent lapses appeared. 

By the use of the standard scale the superintendent is enabled to 
check the results of any experiment in his schools and banish, from his 
own mind at least, any lingering doubts as to the wisdom or lack of wis- 
dom of what he has undertaken. An experiment in one of the Montclair 
schools with a precocious class is a case in point. In September, 1912, 
in this school, a group of fourth-grade children of fairly uniform and 



TABLE I 
Record op Tests 



Watchung VIIA. . . . 
Watchung VHB. . . . 

Grove VIIA 

Special group 











Fundamen- 


Fractions 


English 


Spelling 


Writing 


tal 
Operations 


83.6 


81 


98 


II. 6 


78 


86.9 


80 


98 


II. 2 


80 


77 


71 


97 


II. 4 


69 


87 


83 


97 


II. I 


83 



Superin- 
tendent's 
Test Com- 
position 



42.2 

45.4 
45. 4 
45.8 



superior ability was put in charge of a strong teacher who was instructed 
to allow the class to advance as rapidly as it desired. No pressure was 
ever brought to bear upon the pupils, but dawdling was discouraged. 
The dass remained with the same teacher for two years and in this time 
did three years of work. Four months after the special group entered 
the seventh grade, careful tests were made to determine to w:hat extent 
the experiment had been a success or failure. A comparison of the 
record of the special seventh-grade pupils with that of the entire seventh 
grade with which they had been merged and with two other seventh 
grades of a similar t)rpe showed a very gratifying situation. Tests in 
spelling, arithmetic, and English were given by the principal and a 
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standard test in composition by the superintendent, while the penman- 
ship was rated by the writing supervisor. A conclusion based upon the 
results obtained from these three separate and independent sources can 
fairly be presumed to represent the facts (Table I). 
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Chart V. — ^Improvement in penmanship in Grades V-Vlll at Montclair, New 
Jersey, resulting from the use of a standard measuring scale. (The upper portion of 
each horizontal band represents the quality of the penmanship in the grade indicated 
in September, 191 2. The lower portion shows the quality reached in June, 1915.) 

It should be noted that the records in spelling, fundamental opera- 
tions, complex fractions, and English show rank in percentage, while 
the penmanship rating and the superintendent's test are given in points 
and should be interpreted only as furnishing a basis for comparison. 

That the children had not been advanced too rapidly is further 
indicated by the fact that all of them were regularly promoted at the 
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end of the yeax to the eighth grade, where they are now doing excel- 
lent work. 

Standard tests are not only useful in bringing out the facts concern- 
ing pupils and classes, but are equally valuable in indicating general 
tendencies in the system as a whole. A recent school survey revealed 
the fact that in a certain system of schools the pupils in the fourth grade 
wrote practically as well as those in the ff th grade, while the hand 
writing of sixth-grade pupils was actually better than that of children 
in the seventh grade. Such a departure from a normal curve of advance 
may be justified by some unusual condition. However, the supervisory 
department should be fully aware of the facts if effective remedial 
measures are to be applied, and no amount of theorizing will furnish 
these facts. They can be obtained in only one way — ^by the application 
of one of the standard tests in penmanship. With the returns from such 
a test tabulated and charted, the situation in every grade is at least 
reasonably clear and a definite poUcy can then be formulated with some 
chance of reaching the root of the difficulty. 

The effect of the use for three years of a standard penmanship scale 
upon the quality of the writing of public-school children is indicated in 
Chart V. 

It is perhaps impossible to show by figures the total effect which 
tests of the type indicated here produce in the quality of the work 
of the schools. When purposeful effort is substituted for aimless drift- 
ing, there can be no permanent withholding of successful results. The 
only limits to investigation of this kind are those determined by the 
time which the supervisory department can afford to give to the work. 
It is based upon the fundamental idea of a continual local survey, made 
by those who know the actual school conditions, and who are seeking 
the facts as they exist, for the sole purpose of formulating constructive 
policies. 



CHAPTER VII 

A HALF-YEAR'S PROGRESS IN THE ACHIEVEMENT OF ONE 

SCHOOL SYSTEM 



H. G. CHH-DS 
Associate Professor of Education, Lidiana University 



SECTION A. THE PROGRESS AS MEASURED BY THE THORKDIKE 

VISUAL VOCABULARY TEST 

The following report is based upon the responses of 754 pupils in the 
Bloomington, Indiana, schools to the Thomdike visual vocabulary 
test, which was given during the first week in February and again the 
first week in June, 1915. Only the papers of those pupils were considered 
who wrote both tests. The grades included are the IVB to the VHIA 
inclusive. 

The usual method of tabulating the results has not been followed, 
as the writer thinks that method not the best suited to show the actual 
achievement of any pupil; for example, the first two papers the writer 
took from a pile were each scored '^line 7." In the first of these papers 
the pupil had made the correct response to every word in lines 4, 5, 6, 
and 7 and to one word of line 9. In the other paper correct responses 
had been made to every word in lines 4, 5, and 6, to four words of line 7, 
to two words each of lines 9 and 10^, to three words each of lines 8 and 
10, and to one word of line 11. While both these papers were scored as 
of equal value, the writer is convinced that the ability of the second pupil 
should be rated as nearly double that of the first. By the method of 
scoring used in this report, the first pupil receives a mark of 119 and the 
second a mark of 214.3. 

Assuming that the line values of the scale are correctly assigned (the 
Indiana results indicate that radical revision is needed), and that each 
word within any line is approximately of the same value as any other 
word of that line, why not assign a definite score for each word depend- 
ing upon the line it is in? Such a marking scheme will give a pupil 
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credit for what he actually accomplishes in the test, and will have the 
added advantage of stating the pupil or class ability in one numerical 
result which can be treated statistically with greater ease than in the 
Thomdike scheme. 

The papers in this report have been graded on this basis: every 
correct response in line 4, four points; line 5, five points; line 6, six 
points, etc. — ^line eleven, 18.3 points. The sum of all the word points 
represents the total value of the paper. 

For comparative piuposes the score of any paper or class median can 
be reduced to line and word values of the scale thus: line 4 has a range 
of value from o to 20; line 5, 21-45; ^® 6> 4^-75; line 7, 76-110; 
line 8, 111-150; line 9, 151-195; line 10, 196-245; line loj, 246-297.5; 
and line 11, 298-352.5. 

By this scheme the ability of a pupil or of a class may be stated in 
fractional parts of a line or in terms of the first, second, etc., words 
within a given line; e.g., a pupil whose score is 126 has an ability equal 
to that represented by line 7 and 16 points additional, which is four- 
tenths of line 8, or two words of this line. 

Table I shows the results of the February and June tests. The 
features to which attention is called are: (i) the score of each grade 
in the February test, (2) the gain from grade to grade in the February 
test, (3) the gain of each grade from February to June. 

From this table the median gain from grade to grade by the Feb- 
ruary test is 18 . 8, or, stated in other terms, this gain is the equivalent 
of three words of line 6 or of two words of line 9. The greatest difference, 
38.5, is between Grades VIB and VIA; and the least, 6.7, is between 
Grades VIIB and VIIA. The median gains within each of the grades 
between the February and June tests is 17.3; the highest, 37.5, is in 
Grade VIB and the lowest, 3 . 9, in Grade VIIIA. 

It will be noted that the curves of Chart I show no marked plateaus 
and that the achievement in the VLB grade is double that in the IVB, 
while the VTTTA median is three times that of the IVB. This seems to 
indicate a steady and normal vocabulary development. 

As comparable tests were not available, the same tests were given 
in June as in February. Whether the gain during the term is due to 
the natural growth in vocabulary on the part of the pupils or to their 
having remembered some of the words from the February test and looked 
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them up afterward as a matter of curiosity^ I camiot say. I think the 
latter is true in only a very few cases. 

TABLE I 
Thoxndike Visual Vocabxtlaxy Test (754 Cases) 



Grade 


No. of 
PapOs 

• 


Date 


Score 


P.E. 


Line Value 


Feimiaiy 

between 
Grades 


Gain during 
Term 


IVB . . .. 


91 


Feb. 


81.3 
92.5 


38.5 
38.5 


7.18 
7.5 








June 




II. 3 


IVA . . . . 


85 


Feb. 
June 


107.5 
134.8 


34.8 
35.6 


7.93 
8.63 


36.3 


27.3 


VB 


65 


Feb. 


Z29.0 


48.8 


8.47 


21.5 








June 


151 .0 


41.6 


9.03 




33.0 


VA 


102 


Feb. 


145.3 


34.0 


8.88 


16.3 








June 


156.0 


30.4 


9.13 




10.7 


VIB .... 


81 


Feb. 


164. 1 


43.0 


9.31 


18.8 








June 


30I.6 


43.5 


10. 13 




37.5 


VIA.... 


83 


Feb. 


203.6 


28.0 


10. IS 


38. 5 








June 


219.5 


34.1 


10.45 




16.9 


vnB ... 


63 


Feb. 


313.8 


33.0 


10.36 


10. t 








June 


339.8 


31.7 


10.7 




17.0 


vnA... 


69 


Feb. 


219.5 


35.0 


10.45 


6.7 








June 


240.3 


37.3 


10.91 




30. 8 


VTTTB .. 


60 


Feb. 


338.6 


35.0 


10.87 


19. 1 








June 


256.1 


32.9 


I0i.3I 




17.5 


VHTA.. 


S6 


Feb. 
June 


254.1 
358.0 


36.7 
48.3 


I0J.I7 
10}. 24 


15.5 


3.9 


Grade me 


dian 


Feb. 


183.3 


349 


9.73 


18.8 








June 


310. 6 


34.8 


10.28 




17.3 



To determine if any correlation existed between estimated teaching 
efficiency and class improvement in the vocabulary test, the writer 
secured the ratings of several competent judges on a considerable group 
of teachers in the grades from the IVB to VniA. In the IV and V 
grades where the work was non-departmental| the coefficient of corre- 
lation was negative; in the VI, Vn and Vm grades where the teachers 
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C^AKT I. — Graphic representation of the progress in visual vocabulary o( 754 
pui^ at Blixniington, Indiana, based on Table L 
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of reading and literature were employed for their ability in this line, the 
coefficient was between 0.6 and o. 7. 

SECTION B. THE PROGRESS AS MEASURED BY THE COURTIS TESTS, SERIES B 

During the second semester of the school year 1914-15, the writer, 
in conjunction with Mr. H. L. Smith, then superintendent of the Bloom- 
ington, Indiana, schools, gave the Courtis arithmetic tests in all grades 
of the elementary school from the IVB to the VIIIA, inclusive, for the 
purpose of measuring the growth in arithmetical achievement of pupils 
in this system. The tests were given during the first week in February 
and again the first week in June. The records of the 809 pupils who 
wrote both tests alone are included. 

Table n indicates the number of pupils in each grade who wrote 
both tests and also the median number of attempts and rights, the per- 
centage of accuracy, the percentage gain in rights, and the percentage 
gain in accuracy, for each of the four fundamental processes and for 
both the February and the June tests. 

From this table the gain in achievement from grade to grade may be 
noted for the same date and for each of the processes; also the growth 
in achievement for each process between the February and June tests 
for each grade; and relative achievements in the different processes for 
the same grade and date may be compared. 

In explanation of the results here set forth in comparison with those 
of other systems, it may be noted that formal work in arithmetic is 
begun in the Bloomington schools in the IIIB grade. 

Table n and the accompanying charts show the following features 
worthy of note: (i) the slight gain from grade to grade in the February 
addition results for rights; (2) the marked gain in rights in addition of 
the June over the February results in Grades VI, VII, Vm ; (3) a marked 
gain in rights in subtraction from grade to grade, but a decreasing 
ratio of gain between the February and June tests from Grade IVB to 
Grade VlUA — there being an actual loss in achievement in rights in 
Grades VIIA, VIIIB, and VIIIA; (4) the slight progress in achievement 
in multiplication from grade to grade and the lack of improvement of 
the June over the February results except in Grade IV; (5) the marked 
gain in division from grade to grade in both tests but the lack of any 
marked improvement of the June over the February results in any grade 
— there being a moderate gain in Grades IV, V, and VIHA; (6) that 
the actual achievements in attempts, rights, and accuracy in Grade IVB 
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axe highest in the order of processes as follows: addition, subtraction, 
multiplication, and division. In Grade VIIIA (save for the drill influ- 
ence in addition) the order is division, subtraction, addition, and multi- 
plication — the latter two have about equal rank; (7) that the increase 
in accuracy from grade to grade is most pronounced in division, ranging 
from 38 . 4 in the IVB February test to 89 in the VIIIA June test; and is 
least pronounced in addition (save for the drill influence preceding the 
June test); the percentage of accuracy as indicated by the February 
test is ss in both Grades IVB and VIIIA. 

The marked gain in accuracy and in rights between the February 
and the June tests in addition in Grades VI, VII, and VHI, is accounted 
for by the fact that a five-minute daily drill in addition was given for a 
period of ten weeks in the interval between the two tests in these grades.' 

An average gain in rights of 42 per cent and in accuracy of 14 per 
cent in addition, under drill conditions between the February and June 
tests, in Grades VI, VII, and VIII, indicates that present standards, 
under conditions of ordinary class work, are no indication of what these 
standards should be when experimentation has shown the way to a better 
procedure. 

The marked gain in results in addition between the February and 
the June tests and the lack of gains in the other processes in Grades VI, 
Vn, and VIII indicate that results may be expected at the point where 
pressure is exerted and that there is no appreciable transfer of training 
from one process to another. 

In grades from IVB to VlllA, the teachers were rated as to their 
general efficiency by four judges and the averages of these ratings were 
correlated with the amount each teacher's dass gains in arithmetic were 
above or below the median dass gain, as measured by the February and 
June tests. In Grades IV and V, where the teachers have charge of ail 
subjects, the Pearson coeffident was about +0.30, but in the depart- 
mental grades, where teachers of arithmetic are employed because of 
their profidency in teaching this subject, the coeffident of correlation 
was above +0.90. 

These results are offered as data from one school system only and 
are not to be considered as determined general standards of achievement 
and growth in arithmetical abilities. 

' Acknowledgments are due to Miss Mary Kerr, prindpal of the departmental 
school, who planned and carried out the drill work in addition and assisted in the 
tabulation of results. 



CHAPTER Vni 

COURTIS TESTS IN ARITHMETIC: VALUE TO SUPERINTENDENTS 

AND TEACHERS 



S. A. COURTIS 
Supervisor of Educational Research, Detroit, Michigan 



From August i, 1914, to August i, 1915, between four and five hun- 
dred thousand tests (455,007) of the various Courtis standard research 
tests were sent from Detroit to school men in 42 different states. This 
material was mainly Series B Arithmetic Tests, and the growth from the 
use of the tests by a single school in 1909 may be taken as an index of the 
growth throughout the United States of the interest in the movement 
for measurement. It should be evident at once that if this great quantity 
of material is being used so as to result in benefit to the schools tested, 
then measurement must be already exerting throughout the country 
a very widespread influence on the teaching of arithmetic. On the 
other hand, this extensive use of testing material may represent merely 
natural curiosity and an experimental trial by wide-awake school men 
of a new and much-discussed type of examination. 

Fortimately, measurement itself is not on trial. The movement 
for measurement is merely an application of scientific methods to the 
study of educational problems. Both as a general method for the dis- 
covery of natural law and as a method of proved worth in education, 
the method of science rests on so sure a foundation that for a school man 
to declare that in his hands measurement has been a failure is to confess 
his own lack of training or his own incompetency. As for the Courtis 
tests, they were designed by the writer for a specific purpose, viz., to 
measure the effects of his own teaching and of methods invented to 
improve its efficiency. This purpose has been successfully accomplished. 
For the writer's own purposes the tests yield results which are satis- 
factory and which have fully justified the time and effort given to the 
testing work. Further, the returns received from other schools to 
which the tests were sold on the co-operative basis have yielded informa- 
tion which has proved of the highest professional interest and value to 
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him. Moreover, the tests have given satisfactory service in the hands 
of so many professors and students of education that their value as tools 
for educational research is well established. But whether or not either 
the method or the tests are of value to superintendents and teachers 
generally is quite a different question. 

Accordingly, at the request of the chairman of the Committee on 
Standards and Tests of Efficiency, an investigation of this question was 
undertaken. The following letter was sent to 200 superintendents in 
30 states, all of whom had recently purchased copies of the Series B 
Arithmetic Tests: 

Dear Sir: 

I am in receipt of a request from the Committee on Standards of the 
N.E.A. asking for the conclusions of supenntendents as to whether or not the 
use of the Courtis Standard Tests in Arithmetic has been of any value to them 
or to their teachers from the standpoint of school administration or teaching. 
Any statement that you may be willing to send me will be forwarded to the 
committee. 

Thanking you for such assistance as you may be willing to give, I am, 

Yours very truly, 

S. A. Courtis 

At this writing replies have been received from 87 superintendents 
in 30 states and they are still coming in. The states represented are 
Alabama, California, Colorado, Connecticut, Illinois, Indiana, Iowa, 
Elansas, Michigan, Minnesota, Missoiuri, Montana, Nebraska, New 
Hampshire, New Jersey, New York, North Carolina, Ohio, Oklahoma, 
Oregon, Pennsylvania, Rhode Island, Tennessee, Texas, Utah, Virginia, 
Washington, West Virginia, Wisconsin, and Wyoming. 

The general tone of these letters is remarkable for its enthusiastic 
commendation of the value of measurement to superintendents, teachers, 
and pupils. Such expressions as "Delighted with results," "Should 
not like to do without them," "Do more than anything else we have 
ever tried," or their equivalents, occur in the majority of the letters. 
Seven of the eighty-seven stated that their results have not been tabu- 
lated because of lack of time. Only two express dissatisfaction. The 
following letter represents the extreme of imfavorable comment: 

Repl3ang to yours of the 29th ultimo, I regret to say that I have not dis- 
covered any material benefit from the Courtis tests as we applied them last 
year. 
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If one had a large amount of statistical assistance they might be worth 
while, but as a superintendent with a limited force I question their value. 

Yours sincerely, 
[The name is omitted for obvious reasons.] 

On the other hand, many of the other letters show a careful study 
of the problem and a thorough analysis and formulation of the benefits. 
The following letter is an illustration: 

Burlington, Iowa, October 4, 191 5 
Mr, 5. A. Courtis 
82 Eliot Street 

Detroit, Mich, 

Dear Sir: The Courtis Standard Tests in Arithmetic have been of great 
value to me in indicating: 

I. The school or schools in which there is a regular increase in ability of 
the pupils in the fundamentals of arithmetic. Such knowledge has enabled 
me to suggest to the principals in those buildings where there is no such regular 
increase in ability of the pupils methods of bettering the product of their 
teaching. 

n. The room or grade in which there has been no increase in ability during 
the semester. This indicates in some measure the work which the teacher is 
doing. It affords the superintendent an excellent basis for discussing in detail 
with the teacher the faults or good points in her work. 

ni. The school or grades in which there is a tendency to emphasize the 
work of the fundamentals beyond what is reasonable. Teachers like to do 
what they can do well. Their interest in those subjects which they like some- 
times carries them too far. 

From the statements made to me by teachers and principals I am confident 
that the tests have not produced as good results as they should, but this is not 
the fault of the tests. As the teachers come to understand the purpose of the 
tests, the value of this work becomes more and more apparent to aU. 

I do not think that we care to give up the tests under any drcmnstances. 

Yours very truly, 

W. L. Hanson, Superintendent 

It is to be regretted that space prevents quotations from many 
others. RepUes were tabulated, as follows: 

Replies 

Total replies received 87 Tabulations not completed 7 

Unfavorable 2 Favorable 78 
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Benefits Mentioned 

General answers only 17 Reveal needs of individuals 23 

Comparison with other cities .... 14 Stimulate teachers 23 

Comparison from grade to grade. . 7 Stimulate pupils 17 

Reveal weak points in school work 11 Furnish standards 24 

Reveal weak teachers 13 Furnish incentive or motive 16 

The results do not lend themselves to statistical tabulation, owing 
to the variation in the forms used in expressing the same ideas. Other 
important uses appearing in these letters are '^ Measurement of the 
efficiency of various methods," "Measiurement of the progress of indi- 
vidual children," "Value in grading," "Awakening of spirit of investiga- 
tion among teachers," "Satisfaction of parents." 

The conclusions to be drawn from the foregoing data are that for 
the most part the superintendents who applied for standard tests are 
making legitimate use of them for purposes of supervision; that these 
men value the comparison from city to city — ^made possible by uniform 
tests and conditions — as a check upon the main character of the work 
done in their own systems; that the use of standard tests results in 
the setting up of objective standards which affect the work of teachers 
and pupils favorably, both by making clear the goal to be attained and 
by furnishing motives for individual effort; that the tests are of great 
value in the determination of the needs of individual children and in the 
adjustment of school work in arithmetic to such needs; that the tests 
have some value, the amount of which is yet to be determined, in the 
judging of the efficiency of teachers and in determining the grades of 
children; that few superintendents are making use of the tests in a 
scientific study of the comparative efficiency of different methods of 
teaching. 

The rapid increase in the nimiber of tests that have been used each 
year is, therefore, probably due more to the value of the results secured 
than to mere curiosity in a passing fad. The use of standard tests for 
purposes of supervisory control under such conditions is sure eventually 
to have profound influence upon the teaching of arithmetic. 

The writer is glad to have this chance to express his appreciation of 
the co-operation of the many school workers who have made this exten- 
sive experimental use of the research material possible. The financial 
biurden and office labor of carrying on, without profit, a co-operative 
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venture totaling some $5,000 or $6,000 a year has not been light; neither 
has the labor of tabulation of returns. It is therefore gratif3dng to find 
that this work has been of real value to many superintendents, and the 
result of the investigations made for the committee will be to stimulate 
further efforts to secure standards of teaching efficiency and to extend 
the range of the testing material. 

VALIDITY OF STANDARD SCORES 

The first tests in arithmetic were issued in 1911 and distributed 
widely in an attempt to secure standards for use in the writer's own 
classes. The first tabulation of the returns obtained was in Jime, 191 1, 
and every year since that date additional tabulations have been made. 
Series B tests were issued at the beginning of the year 1913-14, and 
standards based upon the first tabulations were issued in February, 
1914. At this time, however, both the tests and the method had reached 
a stage of development which made possible effective work, so that no 
change in standards has been necessary since that time, although tabula- 
tions of larger and larger numbers of scores have been repeatedly made. 
The standard scores set for Series B are as shown in Table I. 



TABLE I 
Standard (June) Scokes. Series B Tests 



Grade 



in.. 

IV.. 
V... 
VI.. 

vn. 
vm 



Test! 
Addition 



3 
5 

7 

9 
II 

12 



Testa 
Subtractbn 



4 
6 

8 

10 

II 

12 



Test^ 

Multiphca- 

tioD 



3 
5 
7 

9 

10 
II 



Test 4 
Division 



2 

4 
6 

8 
10 
II 



Standard accuracy « zoo per cent. 

The scores given in Table I represent approximately the median 
speed of work for the different grades and are based upon returns that 
are nearly nation-wide in scope. The range of variation in schools in 
different cities and states is approximately four examples above and 
below the median; i.e., in some school systems the median eighth-grade 
scores will rise as high as 16 examples in addition and others go as low 
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as 8 examples. Not more than five eighth-grade classes per hundred 
will exceed these limits, except as very peculiar and special conditions 
prevail. On the other hand, the range of speed of work in individuals 
varies from a score of but two or three examples to scores of twenty-four 
examples, the limit of the test. 

The conditions from city to city do not show greater variation in 
achievement than are to be found in any one city, such as Boston or 
Detroit, where there is a large number of classes of the same grade. If 
returns from small cities or country schools only were tabulated, the 
median scores for any given grade would probably tend to be somewhat 
lower. The large-city school apparently emphasizes the drill work. 
The problem of setting of an adequate standard is, therefore, a difficult 
one. Any standard adopted must take into consideration the effect of a 
number of different factors. All things considered, it has seemed best 
to take as a standard of speed the median speed derived from tabulations 
of all types of systems. There should certainly be no attempt to press 
training in addition, for instance, to very high levels of ability at the 
expense of more important work, and very few school men are willing 
to neglect in any way training in such fundamental abilities as the four 
operations. Median speedy determined from a wide range of conditions, 
probably represents the optimal speed at which children can work. A 
trial in the classroom of such speeds as standards has 3delded satisfactory 
results. 

The question of standards of accuracy ^ however, is a much more 
difficult one to settle, because less information is available and there is " 
more room for a play of personal opinion. The writer has as yet reached 
no conclusion in the matter, but is endeavoring to determine the degree 
of accuracy which it is practical to attain under classroom conditions. 
For this purpose it is necessary to set before teachers as a goal to be 
reached the highest ideals possible — ^i.e., loo per cent accuracy — ^then 
to determine in terms of the percentage of the class reaching this goal the 
degree of success which it is possible to attain. For instance, the 
average percentage of children of the eighth grade who show median 
speed with loo per cent accuracy in first draft work is between 5 and 
10 per cent. Experiment proves, however, that it is easily possible 
to raise the group showing perfect accuracy to 20 or 30 per cent of the 
class membership and markedly to increase the number of children 
working with accuracies of 90 and 80 per cent. There is even reason to 
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expect that with proper methods of traimng and by employing standards 
throughout the whole school system, and without change in the time 
given to arithmetic, it will be possible eventually to secure perfect 
accuracy in from 60 to 75 per cent of the children. For the classes under 
his immediate control the writer prefers to keep the standards of median 
speed and 100 per cent accuracy as the goals to be attained. He recog- 
nizes pearly, however, that at present this choice of standards ,must 
rest upon personal convictions only, and school men should feel free to 
change these standards to suit their own opinions. 

There are, however, certain facts, other than the achievements of 
the pupils themselves, which ought to be considered in the determining 
of standards. One of these is the social value of the abilities developed 
by school work. The writer has attempted to answer this question by 
the measiurement of as many adults as possible. 

The first attempt along this line was made in connection with a 
survey of the New York schools for the Committee on School Inquiry. 
Through the kindness and co-operation of Mr. W. D. Ernest, chief of 
Cadet StaS and member of the John Wanamaker New York Commercial 
Institute, the consent of Mr. L3mn, general manager of the John Wana- 
maker department store. New York City, was secured to the testing 
of 50 employees of the company. This group was tested precisely as if it 
had been a class of children in school. It met in one of the company's 
schoolrooms and was tested by one of the force of trained examiners used 
in the New York survey. Exactly the same tests and time allowances 
were used as for the children and the same procedure in conducting the 
examination and in scoring and tabulating the papers was followed 
throughout. Forty-one complete records were obtained. The subjects 
represented six different types of positions in the store and in nimibers 
were as follows: 

Auditing department 5 Salesmen 7 

Billing clerks S T3q)ists 3 

Cashiers 8 — 

Clerks 13 Total 41 

Two of the clerks and six of the sales people were men. The average 
age of the group was approximately nineteen years, ranging from fifteen 
to thirty years. The average term of service for the company, except for 
the group from the auditing department, was a little more than two years, 
ranging from two months to five years. The girls from the auditing 
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department are the product of the store's own training and the term of 
service for them raided from e^ht to fourteen years. The wage paid any 
member of the group is determined by position and term of service, not by 
position alone. The amount ranged from five to fifteen dollars per week. 
Of thirty-six who reported the last grade attended in public school, seven 
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Chart I. — ^Line marked S indicates eighth-grade standard. Scale at left shows 
deviations above and below standard. 



gave high school, thirteen had completed the elementary grades, and 
sixteen were in either the seventh or the eighth grade of the granoimar 
school when they left. 

It was not possible to attempt more than a general study of the 
work of the different groups. The cashiers do little more than make 
change; the clerks and salesmen have a little computation work in the 
handling of sales slips, store records, etc.; the members of the auditing 
department have a larger amount of abstract work and it is routine in 
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character. The auditing department and, to a lesser extent, the billing 
derks are thus the only positions in which arithmetical ability would 
have more than a slight influence in determining the fitness of the 
applicant. 

The tests used were Series A, and in Table n the results are given 
for Test 7 only, a test in the four operations withi whole numbers. The 
scores given in this test do not differ markedly from those of Series B; 
the eighth-grade standard score is about 2^ examples higher. The 
results of the tests are given in Table n and shown in the graph (Chart I ; 
see p. 98). 

TABLE n 
Part B. Avbsage Scoses 



Position 



Salesmen 

Cashiers 

Typists 

Clerks 

BiU clerks... 

Auditors 

Entire group, 




Rigbts 



7.7 

7.7 

9.7 

9.7^ 
14.6* 

15.4* 

10.4 



* Computed scores. Entire tests finished in less than time allowed. 

It will be noted that the scores of salesmen and cashiers fall below 
the eighth-grade standards (14.4 examples attempted, 10 examples 
right); those of the t3rpists and clerks are almost exactly at standard; 
and those of the billing clerks and of the auditing department nm con- 
siderably above standard. Two members from the auditing department 
had very high scores; the best one finished the test in so short a time 
that had enough material been furnished to keep her busy during the 
whole time allowed, her score would have been 38 attempted and 
34 right. 

Before conunenting on these results, however, similar results from 
other soiurces will be presented. Through the co-operation of Miss Ade- 
laide Baylor, derk of the Board of Education for the state of Indiana, 
and the kindness of Mr. Jesse Moore, president of the Columbia School 
Supply Company, tests were given to a group of 66 factory laborers. 
These workmen were of three classes: a group of 20, mostly colored 
men, represented the cheapest labor employed in the factory, average 
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wage lo to 12 cents per hour; a second group of 26 men represented the 
median wage in the factory, average 17.6 cents an hour; a third type 
represented the best labor in the factory outside of the office, average 
wage 21 cents an hour. Tests were also given to a group of 13 sales- 
women, ranging in age from nineteen to thirty-six. The average score 
made by these four groups of employees is shown in Table HI. 

Through the kindness of personal friends and the co-operation of Mr. 
Boyd Fisher, secretary of the Executive Club of the Detroit Board of 
Commerce, additional records have been secured from various types of 
adults. It is difficult, however, to obtain complete data in such cases, 
as information in regard to either age, salary, or occupation is likely to 
be missing. However, in Table III will be foimd the records of a group 
of low-wage girls ranging in age from eighteen to twenty-five, with 
average pay of $400 per year; 3 stenographers, age eighteen; 5 adult 
women, ranging in age from thirty-seven to forty-six, who give their 
occupation as housewife; a group of high-wage women ranging in age 
from twenty-one to forty and in salary from $700 to $1,200 per year; 
14 boys and men representing machinists, steam-fitters, bookkeepers, 
raUway foremen, raUway clerks, trimmers, and salesmen, ranging in age 
from nineteen to forty-four and in salary from $350 to $900 a year; a 
group of 7 high-priced men of independent means, ranging from thirty- 
seven to fifty-nine years of age; a group of 44 Iowa superintendents, 
ranging in salary from $800 to $4,500, and a similar group of Michigan 
superintendents, all about thirty-five years of age, and ranging in salary 
from $600 to $3,600; a group of 17 office employees of an automobile 
company in Detroit, ranging in age from eighteen to thirty-two, and in 
salary from $700 to $1,500 per year; a group of 28 employees of the 
City Gas Company, ranging in salary from $300 to $5,000 per year; a 
group of approximately 80 teachers, mostly women, attending the simi- 
mer school of the George Peabody College for Teachers, ranging in age 
from twenty to forty-five. In Table IV, the individual scores of one 
of the groups are given in full. 

It is evident from these tables that there is an apparent correlation 
between the earning capacity of adults and their scores, but whether 
this is a causal relation or not is another question. The fact that a man 
attains a high position in society is more likely to be due to the superior 
quality of his general abilities than to his ability in arithmetic alone. An 
able individual will profit more by school training than one less gifted, 
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as Thomdike has shown. Nevertheless, the fact remams that individuals 
who occupy positions of large earning capacity have greater ability in the 
four operations than those of less earning capacity. 



TABLE IV 
Individual Scores: Office Force— Automobile Company 



Monthly 
Salary 


Age 


$24.00. . 


14 


60.00. . 


18 


65.00.. 


21 


65.00. . 


22 


65.00. . 


21 


65.00. . 


21 


70.00. . 


26 


70.00. . 


24 


70.00. . 


24 


75.00.. 


24 


75.00.. 


27 


75.00.. 


25 


75.00.. 


23 


80.00. . 


23 


85.00. . 


24 


90.00. . 


27 


125.00. . 


32 



Departmint 



Office boy . . 
Estimating . 
Drafting. . . 
Estimating. 
Engineering. 
Estimating. 
Order 



Estimating.. 
Estimating. 
Drafting. . . 
Timekeeper. 
Cost clerk. . 



Cost clerk . . 
Timekeeper. 
Bookkeeper. 
Accountant. 



Total 



Test No. x 



At- 
tempts 



21 
10 
18 
16 
10 
16 

24 
18 
12 

24 

19 

IS 

24 
24 

24 
24 



299 



Average 18. 7 



Rights 



19 

2 

13 

14 

5 

14 

23 
II 

5 
22 

14 
12 

23 
21 

24 
21 



243 



15.2 



Test No. 2 



At- 
tempts 



23 

9 
22 

18 

10 

14 

24 

17 
16 

24 
20 

22 

22 

23 
20 

24 



308 



19.2 



Rights 



20 

9 
16 

17 
6 

13 

24 

14 

9 

19 
16 

20 

20 

21 

19 
22 



265 



16.6 



Test No. 3 



At- 
tempts 



13 
21 

II 

16 

16 

7 

14 

24 
12 

IS 

19 
12 

14 

19 
20 

14 
24 



271 



16.0 



Rights 



6 
18 

7 

14 

13 

3 
10 

22 

10 

8 

17 
10 

12 

19 

17 
10 

23 



219 



12.9 



Test No. 4 



At- 
tempts 



II 

17 

5 

23 

17 
12 

12 

24 

16 

IS 
12 

12 

19 

24 

24 
12 

24 



279 



16.4 



Rights 



8 

13 
3 
23 
17 
10 
12 
24 
16 

14 
II 

12 

19 

24 

23 
II 

24 



264 



iS-5 



The figures in the tables give some indication of the levels of ability 
to which it is wise to develop such skills in children; for it must be 
remembered that one of the fimctions of the elementary school is to 
equip children with the essential tools for their life-work. The ele- 
mentary school is not at all concerned with vocational training. If a 
boy wishes to become an accoimtant, the development of additional 
degrees of skill in the four operations must be the work of the vocational 
school; for the elementary school is concerned only with the develop- 
ment of skill necessary to meet the demands of an average life. 

The figures in the tables sliow that the level of ability represented by 
scores of 17 examples* would be adequate for the general demands of a 

« See Chart II. 



COURTIS TESTS IN ARITHMETIC 103 

successful life. Tabulations of the actual scores of eighth-grade diil- 
dren, as has been mentioned above, indicate a median speed of 12 
examples. Considering the changes in speed of work which take place 
from the fourteenth to the twenty-fourth year, owing to maturity alone, 
it is possible to say that 12 examples represent an adequate speed for the 
eighth grade. The records of adults so far tabulated thus tend to con- 
firm the standards previously adopted as being suitable goals for the 
elementary grades. 

For those who accept the reasoning in the foregoing paragraphs an 
important decision will need to be made at once. At the present time 
50 per cent of the children already equal or exceed the speed suggested 
as standard, 12 examples in addition. Also 50 per cent of the children 
fall below this speed. It is evident that many children in the grades now 
require additional training to develop adequate speed and it is equally 
true that a very large number of children have already greatly exceeded 
adult skill. For instance, in the report of the survey of the school 
system of Salt Lake City, Utah, in addition 4 per cent of the eighth-grade 
children equaled or exceeded 16 examples and 27 per cent exceeded 
12 examples. If a speed of 12 examples is adequate for the demands 
of life, then it is a waste of time to give the children additional work tend- 
ing to develop their skill beyond this point; yet where 75 per cent of the 
children need such drill to a greater or less degree it is evident that there 
must be a large element of waste in any form of class training in addition. 
The adoption of standards carries with it the idea of limitation of the 
direct training to the standard adopted. For those who adopt the limita- 
tion of training as an educational principle new class methods must 
be devised which permit of the elimination of individuals from the drill 
classes as soon as the standards have been reached and the setting of 
the child's time free for more profitable work. 

In this connection it is interesting to note that skill in certain indi- 
viduals may develop almost without limit under additional training. 
Certain adults have finished the Addition Test No. i. Series B, in a time 
interval which represents scores of 60 to 70 examples with nearly perfect 
accuracy m the standard time limit. The scores of certain eighth-grade 
classes in schools which give an excessive amoimt of drill show correspond- 
ingly high results for children fourteen years of age. As the standard 
is raised above 12 examples, however, it requires an increasing effort 
to reach the higher levels. Moreover, a sorting on the basis of salary 
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of the various scores made by men tends to show that after a certain 
critical level is reached additional degrees of skill do not necessarily 
mean greater earning power. In the graph shown in Chart H, for 
instance, the two axes represent scores in addition (number of examples 
attempted, Test i, Series B) and annual salary. The various cross- 
marks represent the scores and salaries of individual adults. The circles 

RELATION BETWEEN SALARY AND SPEED 
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on the curve represent the median scores of homogeneous groups of 
workers — first three, laborers; the last three, Iowa superintendents. The 
arrows show the range within the groups tabulated and the figures along 
the base of the graph represent the number of individuals in each group- 
It will be seen from the graph that the curve tends to approach a 
maximum of 17 examples from a salary of $1,800 and up. It is to be 
noted, also, that even in the lower ranges of salary there are iadividuals 
of very high scores. The writer interprets the results shown to mean 
that in a general way earning capacity increases with ability to add, up 
to the critical value, and that beyond this limit additional skill has 
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relativdy no effect upon earning capacity. Perhaps a better form of 
statement would be that the time soon arrives in a man's life when ability 
to add ceases to be a determining factor in his social efficiency. On the 
lower levels of general ability, ability to add may have more determining 
force than on the higher levels. All these considerations seem to point 
to limitation of training as a desirable procedure in the grades, and the 
general adoption of the scores recommended as standard with the conse- 
quent elimination from the drill classes of all individuals who reach this 
standard would undoubtedly improve the efficiency of teaching. 

Standards of speed, however, are of little value in themselves, as the 
quality of work must also be considered. The results given in Table II 
throw some light upon a problem of accuracy also. There is apparent 
correlation between earning power and accuracy, and the levels of 
accuracy for the more capable groups range from 75 to 95 per cent, 
depending somewhat upon the operation. Children who attain fixed 
habits which enable them in straight-ahead work to maintain an accuracy 
of 85 per cent will probably be able to hold any position which is open 
to them. It is also probable that the final standard of accuracy 
adopted will be less than 100 per cent; but, as stated above, the writer 
is not yet willing to make a final statement in regard to such standards. 

EFFICIENCY 

With the adoption of definite standards for speed and accuracy 
efficiency may be defined in terms as rigid as those used in physical 
science. The efficiency of any test is the percentage of the total class 
membership which is able to work at standard speed with standard 
accuracy. Thus, if 12 examples in 8 minutes and 100 per cent accuracy 
be taken as standard scores, and if in a class of 40 there are 8 children 
able to equal or exceed these scores, the efficiency of the teaching would 
be represented by 8/40, or 20 per cent. The average efficiency of present- 
day teaching of addition ranges from 5 to 10 per cent if figured on this 
basis. If figured on the basis of a lower standard of accuracy (see 
standards adopted by Boston) the efficiency is, of course, largely 
increased. If standard tests are given at the beginning and the close 
of the year the efficiency of the teaching effort for the year would be 
represented by the difference between the initial and final efficiencies. 

Such a definition of efficiency is, of course, open to the objection of 
unequal units, since to raise one child to standard scores may not be at 
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all equal to raising another child of very different initial abilities to the 
same scores. However, in any unselected class of 20 children the 
range of individual abilities will be so great that the objection of unequal 
units is of no practical significance. Further, it should be most care- 
fully noted that efficiency, as here defined, is simply a measure of how 
completely the goals set as standards have been attained; it is not at all 
a measure of the movement within the dass toward these goals. It is 
probable that a measure of this latter quantity is also needed. For the 
inmiediate problem for the future is the determination of standards of 
teaching efficiency in terms of objective scores for speed, accuracy, and 
amount of time given to the subject. 



CHAPTER DC 
USE OF STANDARD TESTS AT SALT LAKE CITY, UTAH 



ELLWOOD P. CUBBERLEY 
Professor of Education, Ldand Stanford Junior University 



In May, 19151 a survey of the public-school system of Salt Lake 
City, Utah, was conducted by a corps of five workers, of which I was 
director. One of the problems presented at Salt Lake City was that 
of estimating the efficiency of the instruction given. This was made 
especially important by reason of the fact that there had been much 
criticism in the city, on the part of the business men, of the instruction 
in the so-called fundamental subjects in the schools. 

Accordingly, the survey force imdertook to measiure the instruction 
in writing, spelling, composition, arithmetic, and reading in the ele- 
mentary schools of the city. For this purpose nineteen of the thirty 
schools were selected, with due care to touch every t)rpe of community 
from the standpoint of population, social and economic status, and 
general school conditions. The tests were used with the "B" or upper 
classes of each grade only. The tests used were those standard tests 
which have been employed in a number of other cities, and the methods 
used in giving and scoring the tests were as nearly as possible the same 
as in other cities, so as to get as nearly as possible comparable results. 

I. Spdling. — ^The test in spelling was made by using the ten words 
selected by Dr. Leonard P. Ayres and used in the Springfield survey. 
The list of words, was pronounced to the children by the regular class- 
room teachers in the presence of a member of the survey staff, and 
ordinary classroom procedure was followed with reference to such 
matters as writing, pronouncing words of more than one meaning, etc. 
The papers were then collected, immediately scored by the teacher, and 
turned over to the member of the survey staff who was present. 

The results of the test showed that both by grades and for the city 
as a whole the spelling in Salt Lake City was particularly good. The 
average for the city as a whole was 86.0, as against an expectancy of 
70.0. Individual schools averaged as high as 93.0, while the lowest 

107 



Io8 THE FIFTEENTH YEARBOOK 

was 77 . 2. A more detailed examination of the results, however, showed 
large variations between rooms and among individuals within rooms. 
This is conmiented on at some length in the survey report. The general 
conclusions are that the test itself was entirely too easy, that for 40 per 
cent of the children it was no test at all, and that the city is obtaining 
a degree of efficiency in spelling beyond what might reasonably be 
expected of the schools. An examination of the time schedule also 
showed that the efficiency was obtained by an expenditure of time com- 
pletely beyond what might reasonably be expected of a school system. 

2. Composition. — For this test a brief composition was devised, 
similar to that which had been used at Butte and elsewhere, and the 
children were asked to express themselves on paper. The test was 
made in Grades IV-VIII inclusive. The scoring was done in terms of 
the Hillegas scale, not because this scale is itself a perfect one, but because 
it had been used in a number of other cities, and by using it comparable 
results from elsewhere could be set up beside the Salt Lake City 
results. 

The general result of the test showed that the children were well 
qualified for language work, viewed as groups, but that individual 
children showed wide variations in their ability to use English. The 
variations were so wide that it was evident that the ordinary composition 
work could not be conducted in the schools without making it far too 
easy for some and far too difficult for others. The composition work 
did show some marked evidence of imagination and free expression, and 
the results, compared with those in other cities, showed that Salt Lake 
City stood well in the composition tests. It was dear from the results, 
however, that a better classification of the pupils within the grades 
would result in better composition work. 

3. Writing, — Samples of the ordinary writing of the children in 
Grades III-VIII were taken, and these were scored by the Thomdike 
scale. The results of the test showed again that Salt Lake City ranks 
high compared with school systems where the test had been used, that 
the writing work was well up to the standard, and that the time involved 
was not unreasonably long. Median samples of the writing in each 
grade were reproduced in the report with the view to showing that the 
writing of the children in the schools did not offer the basis for the 
criticism of the school writing which the business men were wont to 
express. 
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4. Reading, — ^The new Courtis reading tests were used in testing the 
quality and quantity of the reading in a number of the schools, and 
these were supplemented by a number of personal judgments on the 
quality of the reading. While the reading test is recent and has not 
as yet been perfectly worked out, so that the members of the survey did 
not fed that the results were particularly valuable, yet the showing 
which the Salt Lake City schools made, indicated that the city ranked 
well in point of ability to read rapidly and remember what was read. 

5. ArUhmeUc. — ^Two types of tests were made in arithmetic. For 
the first the Courtis standard tests in addition, subtraction, multipli- 
cation, and division were used, and the scoring was done in the manner 
provided for in the Courtis tests. The second test in arithmetic was one 
in reasoning, and for this the Stone reasoning tests were used. Com- 
pared with a number of other cities in which these same tests have been 
used, the schools of Salt Lake City stood high in the four fundamental 
operations. The city also stood well in the reasoning tests. Detailed 
tables and graphs were presented in the report to show the results by 
grades and by schools. 

SUMMARY AND RECOMMENDATIONS 

Sixty pages in the survey report are devoted to a detailed descrip- 
tion of the tests made, and twenty-one tables and twelve drawings 
fiulher illustrate the results. An attempt was made to draw from the 
results as shown certain conclusions and reconamendations which would 
help the administrative authorities in the improvement of the schools. 
While one needs to read the entire chapter to get the full meaning of the 
conclusions and reconamendations made, these may, nevertheless, be 
summarized as foUows: 

Conclusions. — i. Salt Lake City ranks high among cities of her class 
in each of the $ve studies in which tests were given. 

2. In spelling, so large a percentage of children made a perfect score 
that full interpretation of the results is difficult. The city's average 
standing was 16 per cent above the standard. 

3. In spelling, language, writing, and in the fimdamentals of arith- 
metic, wide differences exist between the results shown for different 
schools. 

4. The differences between grades are, with few exceptions, approxi- 
mately what they should be. 
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5. The range of abilities in any given grade is entirely too great, as 
judged by all five of the tests. 

6. Similarly, the range of abilities within a given class, again in all 
subjects tested, is far too great. 

7. At least one-foiu:th more time is being given to spelling, and 
more than one-foiu:th more to arithmetic, than is justified in the light 
of the best knowledge on the subject. 

RecommendaHons. — i. Spelling should not have more than 60 to 
75 minutes per week, and arithmetic from 75 minutes in Grade n to 
200 minutes in Grade VIII. A part of ^the surplus time from these two 
branches should be given to language work and part to other parts of 
the curriculmn than the subjects dealt with here. 

2. The only economical and pedagogical way of meeting the needs 
of the extremely dull and extremely bright pupils (perhaps from 4 to 
10 per cent of each school class tested) is by a much larger use of imgraded 
rooms, to which the most skilful teachers should be assigned. It would 
be easy for all the larger schools of the city to find from 25 to 50 children 
who ought, for their own sakes and for the sakes of other children as 
well, to be placed in such rooms. This would provide an inestimable 
relief in all class jwork in the school. This is the most evident and the 
most important need which is brought to light by these tests. 

3. The 'best and most constant supervision of this work is needed 
to secure the necessary readjustments. It should be added that, so 
long as the grade lines are stiffly maintained as the only basis for the 
classification of children, part of the value of expert supervision is 
nullified. 

4. In addition to this, promotion by subjects ought to be a possi- 
bility more frequently made use of. When a fourth-grade child can 
read as well as a seventh-grade child he ought not to be kept in the 
fourth grade for reading just because he cannot leave his fourth-grade 
arithmetic. 

5. Briefly, what the schools have achieved in general, they should 
now set themselves to achieve in particular. 



CHAPTER X 
READING 



CHARLES H. JUDD 
Director of the School of Education, University of Chicago 



Progress in the study of reading has been made since the report of 
this committee in 1915 chiefly through the opportunity supplied by the 
Cleveland survey to apply on a large scale the methods developed in 
previous studies. The Cleveland tests in reading fall into two fairly 
distinct groups. The first group was made with exercises selected from 
the readers conamonly employed in the grades. In this group of tests the 
teachers of the whole dty participated. The results show with clearness 
that teachers can conduct productive studies if a little supervision is 
provided, and that results secured by general studies of this type can be 
directly applied to ordinary school work. The second group of reading 
tests carried on in the Cleveland survey was made with standardized 
selections and demonstrates that a satisfactory degree of exactness can 
be attained even in so complex a subject as reading and that the methods 
of instruction in reading, especially in the upper grades, are in need of 
radical improvement. 

The first tests in which all the teachers participated are described 
in the following directions sent to the teachers: 

Tests of Reading — Cleveland Foundation Survey (May, 1915) 

In order to make a study of reading, it is necessary to secure certain facts 
which are not ordinarily noted in everyday classroom work. Special methods 
will have to be adopted in order to secure these facts, but it is a fundamental 
mistake to think of these special recording methods as opposed in any way to 
the ordinary routine of dasswork, or to think of them as replacing for either 
pupils or teacher the regular instruction. A recording device is good just in 
the degree in which it fits into the regiilar work and at the same time gives a 
series of accurate results on the particular point on which information is 
sought. 

Rates of Reading. — ^All reading proceeds at some rate. Children in the 
same dass differ in their rate of reading; children change in their rate of reading 
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as they go up through the school. It is desirable that we get some exact facts 
about these different rates, because rate is in itself important, because we 
find that rate and ability to understand are interdependent, and because rate 
is one of the s3anptoms by which we can readily measure the stage of de- 
velopment of the pupil. 

Interpretation and reproduction. — ^Again, the power to reproduce is culti- 
vated in all reading exercises. This power differs greatly in different children, 
and is affected by the kind of ideas presented in the reading matter. It is a 
more difficult problem to find out how much children understand and are able 
to reproduce than to determine the rate of reading, but we must carry our 
investigation far enough to determine, by studies of the power to repro- 
duce, how far the teaching has been effective in cultivating the child's 
imderstanding. 

Measurement as related to instruction. — ^Measurements of speed and power 
of interpretation will be worth collecting only when such measurements bring 
out the normal facts which are always present, but are for the most part unre- 
corded in reading exercises. Whenever asked to meas\ire speed or power of 
interpretation, the teacher should be sure first of all that the process of measiur- 
ing does not change the character of the exercise as a real class exercise. Have 
a normal lesson. Be sure in every case that the pupils get out of the exer- 
cise just as much instruction as though no recording of facts were going on, 
and follow the reading with the most productive instruction that can be 
given. 

Learning to record facts. — ^The recording of facts presents certain difficulties. 
Usually a person who tries to record facts for the first time finds that he is 
distracted and inaccurate. The first principle which has to be laid down as 
applicable to all this work is therefore the following: Repeat each recording 
exercise several times until it becomes easy. Do not be discouraged if the 
record made the first time does not seem to go well. Furthermore, do not 
throw away the first record. It is worth keeping for purposes of comparison. 

Uniform survey of reading. — ^This survey will aim to find out as much as 
possible about reading in the Cleveland schools. In order to make comparison 
easy the reading matter to be used for the final records of each tyi>e will be 
taken from the Jones Readers, which are in every school. 

Teachers are urged to try the tests with other passages than these desig- 
nated for use in all schools. The more frequently the test can be made with 
various kinds of material, the better prepared will the teachers be to make the 
final uniform test. Records should be kept of all tests made. The prescribed 
passages from the Jones Readers should be used on a given day in each building 
after sufficient preliminary practice to insure that the teachers know how to 
make the tests. 
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Throughout the prdiminaiy practice and the final uniform test eveiy 
reading ezerdse should be made a part of the regular instruction of the 
dass. 

Measuring the rate of oral reading. — ^The simplest measurement under the 
ordinaiy conditions of class work is probably a measurement of the rate of 
oral reading. This record can be made in any ordinaiy reading ezerdse. Do 
not let the children know that measuring is going on. Have them read as 
usual, but let the teacher have a watch and a pencil at hand. When a child 
begins to read, record his name and note the second at which he starts the 
paragraph. At the end of one minute put a mark in the book showing how 
much the child read. Let him read on without interruption to the end of the 
paragraph, as he would in any reading ezerdse. Make whatever comments 
or ask whatever questions would be asked in an ordinaiy reading lesson and then 
go on with a second child. After class cotmt up the lines read by each member 
of the dass in 60 seconds and tabulate the records. It will be fotmd that there 
are certain differences in rate. Later we shall learn more about each child 
when we measure his rate of silent reading and when we measure his power 
of reproduction. 

How the survey wiil use records. — ^By way of antidpation of the kind of use 
which will be made at the surv^ office of these results, it may be pointed out 
that a comparison will be made of different grades and of the records from 
various parts of the dty. It should be stated ezplidtly that good reading 
cannot be judged by speed alone. A very rapid rate of reading in a second 
grade, for ezample, would show that the ezerdse is not a reading ezerdse at 
all, but a memory ezerdse. Too rapid reading in an upper grade would show 
lack of dear entmdatlon. No second grade and no eighth grade should stand 
out of its dass, dther above or bdow. It is possible, therefore, through a 
general comparative study to check up any single set of figiures by the 
general results. If a single set of figures is to be useful, it should reflect 
the facts faithfully. Good records are faithful records, not ezceptional 
records. 

It may be appropriate to remark in this connection that these records are 
not to be used to the advantage or disadvantage of any individual. The value 
of the reading matter, the stage of devdopment of the children, and many 
other general factors will be brought out by this broad surv^. The method 
will also be useful in directing the efforts of individual teachers. The latter 
advamage is one which the survey ought to leave behind, but it does not fall 
within the scope of the survey to pass on individuals. 

Measuring the rate of silent reading. — ^The second measurement is designed 
to bring out the facts regarding silent reading. All schools use silent reading 
in the requirement that pupils study geographies and histories, but too often 
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silent reading is lost sight of as a special problem for the reading-teacher. It 
may be difficult, because such work has not been emphasized, to have an 
ezerdse in silent reading which shall not impress the children as imusual. It is 
especially urged, therefore, that this part of the study be preceded and followed 
in every case by some real instruction and questioning. For example, when a 
passage has been read silently, as will be directed below, let the teacher imme- 
diately verify the reports made by various children by asking them about all 
parts of the passage, especially that which th^ report that they read last. 
Repeat the measurement and the questioning with both familiar and imfamiligr 
matter until the pupils come to realize what a silent-reading exercise really is. 
Furthermore, do not give any direction such as ''repeat each word to yourself 
carefully," or otherwise try to influence the children to read silently by any 
fixed or prescribed method. 

What is wanted is a clear record of how fast the child reads to himself in 
a normal way without skipping on the one hand, or without imduly careful 
looking at each individual word on the other. 

It would be possible to take individual records of the rate of silent reading 
similar to those provided for in the section above on oral tests, but this is 
probably unnecessary, since the class as a whole can be measiued without 
serious difficulties. Start the class off all together. In order to do this, let 
the teacher read aloud to the whole dass in a normal way some part of the page 
immediately preceding that which is to be used for the test. When all come 
to the turning of the page, let the teacher stop reading and note the exact time. 
Let the children go on in accordance with a prearranged plan, each reading to 
himself, with the imderstanding that there are going to be questions asked 
about what he has read. At the end of a minute have each child dose his book 
and report by reproducing on paper the last line which he read. He will not 
be able in most cases to report the line in exact form, but the teacher can judge 
by means of the written record how far the pupil has read. Now have some 
discussion of the passages so as to make sure that all read what they reported 
and that they read without skipping. After school, record the number of lines 
read by each. Try this several times. 

A very good exerdse for the pupils can be made of the requirement that 
th^ coimt the lines read, but their count should in each case be verified by 
the written record mentioned above. 

Later tests. — ^Following these two kinds of tests will come others <^ the 
power of interpretation of the passages read. The detailed directions for these 
interpretation tests will be given out later. 

Uniform test in oral reading, — ^Af ter several preliminary tests of oral reading 
have been made by the methods described, and the results entered on the 
tabulating sheet, the uniform test should be given. In order that the pupils 
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of a given grade throughout the dty may read the same material, the following 
selections have been chosen from the Jones Readers for this test: 

Gnde Book Sdectbns Pages 

2A n Nathan and the Bear 94-xoo 

Ruff's First Adventure 1x9-123 

3A in Peter Johnson's Boots 57- 60 

Rosamond and the Purple Jar. . . 150-153 

4A IV Prof. Frog's Lectiure 116-126 

Queen Alice 12(^136 

5A V Golden Touch 2gr- 39 

Moses at the Fair 69- 71 

6A VI A Gallop of Three 13-17 

A Huntmg of the Deer 47-53 

7A Vn An Old-Fashioned Snow Storm.. . 63- 66 

A Cellar in Siberia 77- 80 

Charley 20- 24 

8A vn Surrender of Granada X6X-167 

Destruction of Ponq)eii X76-X82 

At the conclusion of this test the results should be entered on a new tabu- 
lating sheet. 

Uniform test in silent reading. — ^Af ter several preliminary tests of silent 
leading have been made by the methods described and the results entered on 
the tabulating sheet, the imiform test should be given. The same tests will 
be given in each grade throughout the city. Th^ will be taken from the 
Jones Readers, as follows: 

Gnde Book Preliminaiy Page Test Pages 

2A n XOX X02-X03 

3A m — 97 98-99 

4A IV 6x 62- 63 

5A V 47 48-49 

6A VI 63 64-66 

7A vn 73 64-66 

8A vn 247 248-249 

At the condu^on of this test the results should be entered on the tabulating 
sheet for the results of the imiform test in oral reading. 

What the measurements show. — ^Teachers will note in their own results the 
following facts: 

1. Children differ radically. 

2. Passages differ in difficulty, but the various children in each dass are 
likely to show fairly imiform relative standings whatever the character of the 
passages. Especially may it be noted that unfamiliar passages are sometimes 
easier than familiar passages. 

3. The rates of silent and oral reading differ. 
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The directions as to procedure have been for the most part given in the 
forgoing discussion. The following details may be added: 

In counting, be sure that a line which is shortened by a picture is cotmted 
as a part line. 

At the end of a paragraph count all lines that are half-lines or more as 
though they were full lines. If such a line is less than a half-line, neglect it. 

Be sure that you test in all cases for recognition of meaning, so that the 
pupils will not be tempted to skip or make extravagant reports. 

Make all tests frequently enough so that 3rou have confidence in your 
reports. 

It is suggested that from the beginning each teacher try some written tests 
of the power to reproduce passages, so that when that kind of work begins for 
the survey there will be a dear notion of the precautions which are necessary. 

Some of the t3rpical results of these tests may be presented. First, 
the now well-known difference between the rate of silent reading and 
the rate of oral reading was brought to the attention of teachers by the 
results which they obtained. These results are reported in Table I. 

TABLE I 

Number of Lines Read Orally and Silently in One Minitte by CmLOREN in 

THE Various Grades of 43 Cleveland Schools 



Grades 



n.. 
m.. 

IV.. 
V... 
VI.. 

vn. 
vm 



Lines Read 
Orally 


Lines Read 
Silently 


13 
16 


16 
22 


14 


21 


IS 
16 

16 


20 

24 
21 


16 


21 



No effort should be made to compare the results of successive grades 
with each other, because the length of the lines in different readers is 
different and the content of the passages is of varying difficulty. Even 
so, it is evident that children read more rapidly when they are free from 
the necessity of pronoui^png words. The fact that there is not greater 
difference in the upper grades is imdoubtedly due to the fact that school 
training emphasizes almost exclusively oral reading. 

Fuller details of this contrast between oral and silent reading may be 
seen in Table II, which shows the results in full for the sixth grades of 
five schools. 
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Especially significant is the fact that the deviations from the medians 
are comparatively much smaller in oral reading than in silent reading. 
This means that children in a given grade are more alike in their abilities 
to read orally than in their abilities to read silently. This is explained 
by the fact that the limits of speed in oral reading are determined in 
part by the limits of the purely physiological process of articulation. All 
children in the sixth grade approach this physiological limit of speed in 
articulation. In silent reading, on the other hand, the widest differences 
are possible. That wide differences do appear is clearly shown by com- 
paring the two columns in Table 11 marked ''median deviation." 

TABLE n 
Number of Lines Read per Minute in the Sdcth Grades of Five Schools 



Name ov School 



Addison. . 

Alabama. 
Bolton. . . 

Boulevard 
Brownell. 



No. O T 
PUFZLS 



16 
16 

13 

35 
22 

28 
32 



LiNBS RXAD OrALLT 



Lowest 
Papil's 
Record 



12 
XI 

10 

9 

7 

XX 

6 



Bluest 

Pupil's 

•Record 



24 
23 

x8 

20 
19 

19 
24 



Median 
Record 



19 
14 

IS 

16 
23 

13 

14 



Median 
Devia- 
tion 



2.3 
3.2 

IS 

2.0 
2.2 

IS 
3.0 



Limbs Rxad Sxlkntlt 



Lowest 
Pupil's 
Record 



2X 
IS 

13 

8 
14 

8 
IS 



Highest 

Pupil's 

Record 



41 
32 

29 

44 
SO 

30 
SS 



Median 
Record 



28 
21 

24 
IS 

37 

19 
22 



Median 
Devia- 
tion 



S.7 
4.2 

3-2 

9.S 
7.7 

4.0 
6.0 



The second set of tests — that is, the tests which employed, not the 
common passages from the readers in the hands of the pupils, but a series 
of selected and standardized passages — ^represents an advance in tech- 
nique above the tests made by the whole system. The passages were 
standardized by Mr. William S. Gray. Without entering into the details 
of Mr. Gray's method, it may be stated in general terms that passages 
were selected by teachers and were then graded according to the results 
obtained after use with children of various school systems and various 
grades. 

It is quite impossible to review in full the results obtained by the 
use of these standardized passages. Perhaps the most significant single 
result appeared in the fact that the more rapid the pupil's silent reading. 
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the higher his ability to reproduce what he has read. Some of the evi- 
dence establishing this conclusion is presented in Table III. Three pas- 
sages were employed in this test, one by Grades II-IV, a second by 
Grades V and VI, the third by Grades VII and VIII. The table should 
be read as follows: In the second grade those pupils who read loo words 
in from 102 to 98 seconds, inclusive, made an average quality grade of 17. 
Those who read 100 words in the shorter period from 92 to 88 seconds, 
inclusive, made an average quality record of 19. The table is based on 
data from 1,831 pupils in the Cleveland schools. The full significance 



TABLE m 

Table Showing Relation of Speed and Quauty in Silent Reading 
(Based on data from 1,831 pupils in Cleveland, Ohio) 



Grade 



n... 
in.. 

IV.. 
V... 
VI.. 

vn.. 
vm. 



•is 
Pli 

gMHCTS 



17 
19 



llll 

&M a 



19 

21 



•-ll's 

gOOH 



I 



20 
24 



.a-3'S'g 

gt*H& 



23 
29 

12 
19 



r 



'1 



If 



i 



24 
28 

IS 
20 

27 

xo 



.a^S. 



24 
28 

IS 
20 

28 

17 

19 



1 



g ^«« & 



2S 
30 

17 
22 

22 

19 
21 



III' 



o ftio 






31 

34 
22 

26 

28 

20 

2S 



.a|S 

Q S WJCO 



30 
41 

22 

24 
30 
26 

29 



.alfi 




^.1 
S 



MO Hi 



36 
28 

14 

33 

23 
28 
z8 



of the table is brought out by reading horizontally along the line of each 
of the grades. Thus, for the second grade the score for quality improves 
steadily from 17 to 36 as the speed increases. For the third grade the 
score for quality improves steadily imtil the last stage, where there is 
an exceptional drop. It will be seen that in almost every case increase 
in speed is paralleled by improvement in quality. 

The significance of this result for practical class work is at once 
apparent. Methods which will promote fluent, rapid reading will con- 
tribute in general to clear imderstanding and increase in power of inter- 
pretation. 

The foregoing brief accoimt of the results of the Cleveland survey 
will serve to show something of the character of the methods and out- 
come of the tests. More significant than any of the figures which can be 
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set down in tables, however, is the fact that these results can be used to 
improve the teaching of reading. This practical value of the tests can 
be made clear by referring to three distinct applications of the results 
in Cleveland which will be helpful. 

First, the teachers are made aware by the tests which they themselves 
conducted of the importance of cultivating silent reading by methods 
different from those employed in oral reading exercises. Books on 
methods are full of advice on the teaching of oral reading, but they pass 
silent reading with a casual mention. Yet silent reading is the only form 
of reading commonly employed in later life. Silent reading is necessary 
for the pupil who studies geography or history or any other subject out of 
a textbook. It is accordingly important that the distinction be impressed 
on teachers. 

Secondly, the methods of teaching generally employed in the schools 
tend to make pupils slow in their reading. It is very important that 
teachers learn from a comparison of their own pupils that those children 
who learn to be fluent by personal efforts are also the pupils who can 
reproduce most efficiently what they have read. This fact will serve to 
check all of the criticism which is sometimes heard against schools which 
aim to cultivate rapid methods of mental work. Speed is, within reason- 
able limits, a desirable quality. Speed in silent reading is distinctly a 
virtue. 

Thirdly, there is the broad, general teaching of these tests. They 
show that exact, quantitative studies are highly useful in directing all 
kinds of school work. The arithmetic tests which have been so produc- 
tively worked out by Courtis are accepted by teachers as naturally per- 
mitting a high degree of quantitative accuracy. Writing and spelling 
are thought of as readily reducible to quantitative grades because of their 
relative simplicity. When, however, exact statements can be made 
r^arding reading, the central subject of the elementary course has been 
reached, and the value of exact investigations can be demonstrated more 
fully than in any other subject. 

This final outcome is of such importance to schools in general that a 
chapter of this report has properly been devoted to a paper by a practical 
superintendent, Mr. Oberholtzer, setting forth his experience in con« 
ducting a quantitative study of reading. 



CHAPTER XI 

STUDIES BY THE BUREAU OF RESEARCH AND EFFICIENCY OF 

KANSAS CITY, MISSOURI 



GEORGE MELCHER 
Director of the Bureau of Research and Efficiency, Kansas City, Missouri 



While biireaus of educational standards and measurements (research 
and efficiency) are engaged for the most part in applying to school work 
the objective measures that have been established, yet these biureaus are 
not standardized and no two of them are proceeding in the same way. 
However, many problems are common to all of them. Most of them 
co-operate with the superintendents of their school systems in the analysis 
of school statistics (some handling all the school statistics) ; they direct 
various forms of educational measurements, tabulate the results, and 
furnish the simmiaries and conclusions reached to superintendents, 
supervisors, or principals, to be used in improving educational practice. 
They also study the cost of various items of school expenditure and 
establish standards in school costs; they conduct various forms of 
school inquiries; they make careful scientific studies of any problem of 
school supervision or school administration. These bureaus are attack- 
ing the herculean task of substituting fact for opinion in school practice. 
For generations our schools have been conducted along the lines laid 
down by opinion and precedent. All other forms of business of great 
magnitude that spend vast siuns of money, and affect the welfare of 
thousands of people, are being organized more and more in accordance 
with well-established principles, based on fact. Education is the greatest 
business in which the people are engaged, and this business affects more 
vitally than any other business the life of every person. It is right, then, 
that the people should demand of this enormous business enterprise 
accoimts, both educational and financial, as complete, systematic, and 
accurate as any other business furnishes. The people should know what 
results they are getting for the vast outlay of money they are making. 

During the past year the Biureau of Research and Efficiency of 
Kansas City has studied the following problems: (i) overageness and 
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its causes; (2) non-promotion and withdrawals and their causes; 
(3) opportunity for individual progress in schools; (4) comparative 
study of school elimination and school persistence for the past twenty- 
five years; (5) length of time required to complete the elementary- 
school course; (6) the efficiency of school work in (a) spellii^, (b) 
handwriting, (c) fimdamental operations in arithmetic, (cC) accurate 
copying; (7) the cost of heating, lighting, water, janitor service, etc.; 
(8) grading and distribution of grades in the high schools; (9) revision 
of the reports and records of the school system so as to make them of 
greater educational significance; (10) exceptional children and their 
needs; also (11) several minor problems. 

The work of the Bureau can best be illustrated by extracts from a 
few of the studies made. The following is part of a study showing 
method of attack on cost of heating. 



A. COST OF FUEL PER PX7PIL IN DAILY ATTENDANCE 

The following table gives the 50 largest cities in the United States, 
arranged in the order of the cost of fuel per pupil in daily attendance 
during the school year 1912-13: 



1. New Orleans $0. 37 26. 

2. Richmond o. 37 27. 

3. San Frandsco 0.40 28. 

4. Nashville 0.46 29. 

5. Los Angeles 0.46 30. 

6. Birmingham 0.48 31. 

7. Atlanta o. 58 32. 

8. Oakland o. 62 33. 

9. Memphis o. 66 34. 

10. Louisville o. 69 35. 

11. Paterson o. 71 36. 

12. St. Louis o. 80 37. 

13. Newark 0.83 38. 

14. Baltimore o. 92' 39. 

15. New York City 0.96 40. 

16. Dayton i.oo 41. 

17. Bridgeport 1.03 42. 

18. Detroit 1.09 43. 

19. Cleveland i . 12 44. 

20. Seattle i . 21 45. 

21. Cindnnati 1.22 46. 

22. Milwaukee i . 24 47. 

23. Cambridge 1.27 48. 

24. Grand Rapids i .30 49. 

25. Indianapolis 1.31 50. 



Scranton 

Pittsburgh 

FaU River 

Boston 

St. Paul 

Providence 

Minneapolis 

Toledo 

Philadelphia 

Buffalo 

Spokane 

Jersey City 

Columbus 

Denver 

Portland 

Washington 

Chicago 

Worcester 

New Haven 

Kansas CUy^ Mo 

Omaha 2 

S)n:acuse 2 

Rochester 2 

Albany 2 

Lowell 2 



.34 

35 
.40 

.41 
.43 
45 
•49 
•52 
.52 
.54 
.58 
.60 
.61 

.67 
.68 
.70 

.71 
.83 

.84 
.96 

.10 

.11 

.27 

.37 
.70 
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From the foregoing tabulation it is seen that in 191 2-13 only five 
cities in the United States paid more per pupil for fuel than did Kansas 
City, Missouri, and that only one of these cities was in the Central West. 
Investigation of coal prices indicates that the prices of coal in ELansas 
City, Missouri, are relatively high. However, after allowance is made 
for the higher price of coal, it seems probable that the cost per pupil for 
fuel in Kansas City, Missouri, is 10-20 per cent higher than in cities that 
are able to secure coal at about the same prices as are paid in ELansas 
City. In compiling the foregoing figures, the fuel used in the library 
building and library branches was deducted before making the averages. 
No deduction, however, has been made for coal used by janitors. In 
most cities coal is not furnished the janitors by the school district. The 
coal used by the janitors should not amoimt to more than 5 per cent of 
the bill. Thus it is seen that when allowance is made for the janitors' 
coal the cost of fuel is still relatively high. 

It is fair to Kansas City to note that in recent years this school 
district has erected a large number of new school buildings, containing 
large schoolrooms, spacious hallways, gymnasiums, etc. Such buildings 
equipped with modem ventilating systems and other modem con- 
veniences are necessarily expensive to heat. 

Cost of Coal per Pupil in Daily Attendance 
(Cities in Missouri, Kansas, Nebraska, and Iowa) 



Springfield. . 

Joplin 

St. Louis — 
St. Joseph. . 
Kansas City. 

Kansas City. 
Topeka 



Omaha 

Council Bluffs. 
Sioux City. . . . 

Davenport 

Des Moines . . . 
Cedar Rapids. . 



igzo-zz 



igzz-za 



$0.67 



MISSOXTKI 



.8z 



1.65 

1.34 
I -45 



$0.78 

.79 

.87 

1.78 

1. 81 



KANSAS 



1.30 
1.82 



NEBRASKA 



IOWA 



X.68 



X.06 
1.56 
1.71 

1.86 
2.12 



X9ia-i3 



$0.70 

.73 
.80 

1.83 

X.96 

1.48 
1.53 



1.04 

1. 55 
1.72 

1.49 



1. 8s I 2.09 I 



1913-14 



So. 79 

.76 

.76 

1.69 

1.77 
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Cost of Coal per Pupil in Daily Attendance in Each School Building 

IN Kansas City, Missouri 



1. Kensington 

2. Sixty-first Street 

3. Askew 

4. Milton Moore 

5. Henry C. Kumpf 

6. Irving 

7. Shiloh 

8. Jefferson 

9. Manchester 

10. Woodland 

11. Swope 

12. Hale H. Cook 

13. Emerson 

14. Washington 

15. Hamilton 

16. Scarritt 

17. Switzer 

18. Horace Mann 

19. Benton 

20. Greenwood 

21. Frances Willard 

22. Troost Avenue 

23. Lincoln 

24. Humboldt 

25. Morse 

26. William Cullen Bryant 

27. Martin 

28. Whittier 

29. James 

30. Hyde Park 

31. Fairmotmt 

32. Lowell 

33. Van Horn 

34. Faxon 

35. Yeager 

36. Franklin 

37. Ashland 

38. Allen 

39. Garfield 



$0,735 s 

0.783 S 

0.838 S 

0.840 S 

0.883 s 

0.944 O 

0.956 S 

0.964 H 

.019 S 

.023 O 

.024 S 

.049 S 

.058 S 

.058 o 

.101 o 

.102 o 

.114 o 

.136 o 

.147 o 

.155 O 

.178 s 

.184 H 

.203 O 

.212 o 

.215 O 

.254 s 
.277 s 

3" O 
.323 o 

.357 O 

.362 s 

.384 o 

.409 H 

.419 O 

.424 O 

.475 H 
.480 O 

.536 O 

.600 o 



Manual Training High i . 905 O 

Westport High 2.251 O 

Lincoln High 2 . 694 O 

0"B(nl. S">tolt coal (bituminous). 



40. Wendell Phillips 

41. Bristol 

42. Linwood 

43. G. B. Longan 

44. Karnes 

45. Penn 

46. Thacher 

47. Blenheim 

48. Bruce 

49. Booker Washington . . . 

50. Wheatl^ 

51. Lykins 

52. Attucks 

53. Moimt Washington. . . 

54. Bancroft 

55. Norman 

56. S. B.Ladd 

57. Douglass 

58. Garrison 

59. Adams 

60. Webster 

61. Rollins 

62. Swinney 

63. LongfeUow 

64. Blue Valley 

65. Jackson 

66. Special 

67. Marlborough 

68. Seven Oaks 

69. McCoy 

0. Sunmer 

1. Graceland 

2. Benjamin Harrison. . . . 

3. Clay 

4. J. S. Chick 

5. S.O.Allen 

6. E.C.White 

7. Lathrop 

8. Madison 



1.636 H 
1.662 H 
1.684 O 
1.686 O 
I. 712 H 

1.734 s 
1.753 O 

1.80 S 
1.825 S 
I. 861 S 
1.897 S 
1.907 H 

1. 913 H 
I. 915 H 
1.944 O 

1.962 O 

1.963 H 
1.972 S 
2.084 H 
2.086 H 
2. no H 
2. Ill O 

2.135 s 

2.146 H 

2.164 s 

2.204 s 

2 . 262 S 

2.337 s 
2.515 s 

2.817 s 

2.848 S 

2.851 S 

2.896 S 

2.954 H 

2.980 S 

3.426 S 

3.454 s 

3.891 H 
4.596 H 



Central High 4. 079 O 

Northeast High 4. 904 S 

H^hard coal (anthracite or semi-anthracite). 



From the table on p. 122 it is seen that the cost per pupil for coal in 
Kansas City, Missouri, averages higher than the cost in any other city in 
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this group of states except the dty of Omaha. The average cost is more 
than 20 per cent greater than in Kansas City, ELansas, more than 10 per 
cent greater than in Topeka, Kansas, and more than double the cost in 
St. Louis, Missouri. A large part of this latter difference is accoimted for 
by the fact that St. Louis buys the best grade of Illinois lump coal (bitimii- 
nous) at a very low rate. This year St. Louis has contracted for its coal 
at $1 .Qif per ton, whereas Cherokee coal costs the Kansas City school 
district $3 . 54 per ton and is not so good a quality of coal as the Illinois 
lump. While this difference in the price and quality of the coal will 
accoimt for a large part of the difference in the cost in St. Louis and 
Kansas City, it does not account for all of it. It would seem from these 
figures that the cost in Kansas City is from 10 to 20 per cent higher rela- 
tively than the cost in St. Louis or than the cost in the neighboring towns 
in ELansas. 

Group /. — ^The largest group of school buildings is heated by steam 
hot-blast. There are 28 schools in this group. The lowest cost in this 
group was $1 ..102 per pupil in the Scarritt School, and the highest cost 
was $3,454 per pupil in the E. C. White School. It would seem that it 

Twenty-eight Buildings Heated by Steam Hot-Blast and the Cost 

PER Pupil 

Scarritt $1 . 102 

Switzer i . 114 

Horace Mann i . 136 

Benton i . 147 

Greenwood i • iSS 

Humboldt 1.212 

Morse 1.2x5 



Whittier i 

James $1 

Hyde Park i 

Van Horn i 

Faxon i 

Franklin i 

Ashland i 



311 

323 

357 
409 

419 

475 
480 



Allen $1 

Garfield i 

Linwood i 

G. B. Longan i 

Thacher 

Lykins 

Attucks 

Bancroft 



Percentage 

above 
Median Cost 

536 2 

600 6 
684 II 
686 II 

753 16 
907 27 

913 27 
944 29 



Norman $1 . 962 

S. B. Ladd 1963 

Rollins 2. Ill 

Benjamin Harrison 2.896 

*Clay 2.954 

E.G. White 3.454 

Median cost i . 508 



Percentage 

above 
Median Gwt 

30 
30 
40 
92 
96 
130 



* Investigation has developed the fact that in this new iS-room building only ii rooms were 
occupied, but that all z8 were kept' heated all winter. The heat should have been cut on from 7 of these 
rooms and Uius more than one-third of the cost saved. 



STUDIES BY BUREAU OF RESEARCH OF KANSAS CITY 12$ 

should not cost more than $1.51 per pupil to heat these buildings, since 
one-half of the buildings were heated for less than that cost. Note that 
seven buildings in this group were heated for less than $1 . 22 per pupil. 
This m^t indicate that $1 . 20 to $1 . 25 per pupil is a fair cost for heating 
such buildings when the firing is properly managed. No school in this 
group has less than eight rooms. The Faxon and the Clay buildings 
are both new and built on the same plan. 

Group II. — ^The second largest group of school buildings is heated 
by direct steam. There are 16 in this group. The lowest cost in this 
group is the Irving, $0,944 per pupil, and the highest cost is the Long- 
fellow, $2 . 146 per pupil. The median cost is $1 . 331. However, it will 
be noted that 6 of this group are heated for less than $1 .06. It would 
seem from the very nature of the case that direct steam heat should be 
cheaper than steam hot-blast. Hence it would seem that $1 . 05 to $1 . 10 
per pupil is a fair cost for such heat. 

Sixteen Buildings Heated by Direct Steam 

Irving I0.944 Yeager $1,424 

Jefferson 0.964 Phillips 1.636 

Woodland 1.023 Kames 1.712 

Emerson 1.058 Garrison 2.084 

Washington 1.058 Adams 2.086 

Hamilton i. loi Webster 2. no 

Lincoki .1.203 *Longfellow 2.146 

Martin 1277 Median cost 1331 

Lowell 1.384 

* An incompetent Janitor is named as the explanation of the high cost in the Longfellow. 

Three other groups of elementary school buildings were studied in a 
similar manner. 

Group VI. High Schools.— 

Manual Training High $1,905 Central High. 4079 

WestportHigh 2.251 Northeast High 4904 

Lincoki High 2.694 

The cost here is necessarily greater than in the elementary schools, 
as more cubic feet of space per pupil must be heated. However, in some 
of these schools the cost seems excessive, especially in the Northeast 
High School, with a cost of $4.90 per pupil. The operation of the air- 
washer adds something to the cost of the heating in this building. The 
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fact that the building stands in the open and is fully exposed also adds 
to the cost. After a reasonable allowance is made for this additional 
costy the still excessive cost would indicate one of two things: incorrect 
and wasteful methods of firing or improper fire grates or fire boxes 
causing excessive waste of fuel. A saving of $i,ooo to $2,000 on the 
coal bill of this building would seem possible. It is impossible at this 
season of the year, August, to determine the real cause of this high cost. 
However, this may be worked out during the next school year. 

GENERAL CONCLUSION 

It seems evident that by proper attention on the part of the janitors 
to correct methods of firing and of economizing fuel an annual saving of 
from $5,000 to $10,000 could be made in the district. 

The cost per 1,000 cubic feet to be heated may be fairer than the cost 
for each pupil, but the dimensions of the buildings were not available for 
this study. 

Note I. — ^Three kinds of fuel are used — oil, soft coal, and hard coal. 
Some allowance must be made for var3dng cost of the kinds of fuel. 

Note 2. — ^In 1915-16, the Central High School will be opened. This 
building is very similar to the Northeast Building and will be heated by 
slack fed into the furnace by mechanical stokers. This will enable an 
acciurate comparison of the cost of heating in the two buildings to be 
made. In the Northeast High School soft coal is used; oil is used in 
all the other high-school buildings. 

Such studies as this show conclusively the need of standards for the 
cost of heating, lighting, water, supplies, janitor service, etc. 

B. STUDY OF SCHOOL PROGRESS 

The following study was made of the Kansas City, Missouri, ward- 
school graduates of Jime, 1915. 

Just before the close of the school year the following "Individual 
School History" blank was sent to each member of the graduating class 
by the Bureau of Research and Efficiency: 
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Imdiyidual School History 

SEVENTH-GRADE PUPILS 

1. Name Street Address 

(Write raniame fint) 

2. When were you bom ? Year , Month , Day 

3. Where were'you bom ? 

4. What will be your age June 11, 1915? Years , Months ,Days 

5. Did you attend kindergarten ? When ? Where ? 

How many months ? 

6. In what year and month did you first enter school (not kindergarten) ? 

Year , Month 

7. Where did you first enter school ? In what grade ? 

8. How old were you when you first entered school (not kindergarten)? 

Years , Months 

9. Have you attended school a part or all of each school year since you entered 

school ? 

10. How many school years or parts of school years have you attended school ? 

11. Have you ever missed as much as five (or more) consecutive months of 

school ? List below each such absen;ce from school: 
When (year) ? Number of months ? Why ? In what grade ? 

a 

b 

c 

12. When did you first enter school in Kansas City ? 

In what grade ? 

13. Have you at any time repeated a grade or a dass ? If so, what grades or 

classes? 

14. Have you at any time skipped a grade or class ? If so, what grades or 

classes? 

Careful directions were sent as to the method that should be pur- 
sued and the care that should be exercised in answering the questions, 
in order that the answers might be as accurate as possible; though the 
children depended upon their own memory and that of their parents, 
it is felt that in most respects the answers are fairly accurate. 

It will be noticed that many of the questions are so put that the 
answers serve as a check upon each other. The papers were carefully 
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examined before the study was made, the answers compared and checked, 
and corrections made wherever it was evident an error had been 
made. 

In this study we had in view the following problems: (i) to deter- 
mine the time required to finish in the seven-year system which is in 
force in the Kansas City schools (bo3rs and girls were kept separate in 
the study); (2) since about one-half of this dass had a year's work in 
the kindergarten before entering the grades, a secondary problem was 
to determine the length of time required to finish by kindergarten chil- 
dren and also by non-kindergarten diildren (those who had not had work 
in kindergarten) and to compare the progress of the two groups in the 
matter of time required to finish; (3) some secondary problems that are 
omitted here. 

It is felt that the first problem is of special interest because Elansas 
City has only seven years in the elementary-school course. 

All children who entered the Kansas City schools after 1910 were 
excluded from this study in order that all children included might be 
placed upon an equal footing in regard to the school system. In doing 
this it was assumed that the difference in the first two years' work would 
not be very great, whether in a seven-year or an eight-year system, and 
that a child having had two years' work outside of ELansas City would 
usually enter the third grade upon coming to Kansas City. When a 
pupil was absent more than one-half the year, that year was not coimted 
as a school year for him. Of the 2,084 white graduates in 1915, 378 
were excluded and 1,706 were used for this study. 

TABLE I 
Number of Pupils Studied, Includino Einderga&ten 

AMD NON-EDn>ERGA]lTEN 



/ 


Boys 


Girla 


Total 


ISTii^^h^T of p^ipils studied 


847 
417 
430 


859 
406 

453 


1.706 


Number of kindergarten pupils 

Number of non-kindergarten pupils. . . 


823 
883 



Table II shows that this class was about equally divided between 
seven and eight years in time required to finish; that a small number, 
96, required less than seven years, and 239 required more than eight 
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years. Five pupils finished in five, years. Four of these were non- 
kindergarten pupils and were overage at entrance into school. 

TABLE n 
Number Finishing and Years Required 





Number or Ykass to FnnsH 




xa 



I 



I 


XX 


xo 


9 


8 


7 


6 

12 
22 
26 

31 
91 


5 

3 

I 

I 



Total 


Number of boys, non-kindeigarten 
Number of girls, non-kindergarten 
Number of boys, with kindergarten 
Number of girls, with kindeigarten 


5 







12 
14 

8 
5 


73 
50 
48 
23 


192 
206 

145 
142 


133 
159 
189 
205 

686 


430 
453 
417 
406 


Total 


5 


39 


194 


68s 


5 


1,706 


Percentage, total 

Percentage, non-kindergarten boys 
and flfins. ^ , , . , . ^ , ^ - r - r 


0.05 
0.12 
0.00 


0.29 

0.57 
0.00 


2.28 

2.95 
1.58 


"37 

13.93 
8.63 


40.21 
45.07 
34.87 


40.15 
33.07 
47.87 


5.33 

3.85 
6.92 


0.29 
0.45 

O.Z2 


zoo 
100 


Percentage, kindergarten boys and 
sirls 


100 







Table m shows that the class as a whole required about seven and 
two-thirds years to finish the course, a saving of about o. 75 of a year 
over the eight-year system, since the average time required in most 
eight-grade systems is about 8 . 4 years. The time required for the girls 
is slightly less than that for the boys. 

TABLE m 

Average Time Required y^^ 

Average time for all boys and girls 7.65 

Average time for all b<^ 7.72 

Average time for all girls 7.58 

Table IV, which is a comparison of kindergarten and non- 
kindergarten children, . shows that in the matter of time required to 

TABLE IV 
Comparison of Time Required by Kindergarten and Non- 

EllNDERGARTEN CmLDREN 



Average time required, boys and girls. . . 

Average time required, bojrs 

Average time required, girls 



Non- 
Kindergarten 




Kindergarten 



7.50 
7.56 
7.4a 
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finish the kindergarten children have an advantage of about three- 
tenths of a year over the non-kindergarten children. The kindergarten 
girls also finish in less time than the kindergarten boys. An average of 
only 7.42 years was required by the kindergarten girls. 

Table V is another comparison of the time required to finish. In 
making this study, the necessity for a system of cumulative records 
whereby the advancement of a child through the grades can be traced 
accurately became clearly evident. 

TABLE V 
Time Required to Finish 



All, bojrs and girls 

All,kindergartenboysandgirls 
All, non-kindeigi^teii boys 

and girls 

EJndeigarten boys 

Eindeigarten girls 

Non-kindergarten boys 

Non-kindergarten girls. . . . 



7 Yean or 


8 Yean or 


Lets 


More 


78a 


924 


452 


371 


330 


553 


216 


201 


236 


170 


148 


282 


182 


271 



Total 

1,706 
823 

833 

417 
406 

430 
453 



C. OPPORTUNITY OF INDIVIDUALS 



The following summaries taken from the reports on double promo- 
tions, special promotions, and special demotions give an insight into the 
chance that the individual will have his special needs met and that he 
will be considered apart from the mass or group. 



TABLE VI 

DoxTBLE Promotions during the Second Thirteen Weeks 

OP THE Year 1914-15 



First grade 22 

Second grade 18 

Third grade 18 

Fourth grade 14 



Fifth grade . . . 
Sixth grade. . . 
Seventh grade 

Total 



9 
6 

I 
88 
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Combining the SS, the 436, and the 420 cases of Tables VI, VII, 
Vni, we have only 944, or less than 3 per cent of the elementary-school 
enrolment, that received special promotions, demotions, or double pro- 
motions during one-third of last year. Are there not more pupils needing 
this special attention ? From Table VII it is to be noted that it is two 
and one-half times easier to secure a special promotion in the same 
room than to a higher class in another room (315 were promoted within 
rooms, and only 121 to other rooms). It would appear that the barrier 
between rooms must be somewhat greater than between classes in the 
same room, though such a circumstance clearly ought not to operate 
to limit the child's opportunity. 

TABLE Vn 
Special Promotions to Higher Classes 





In Another 
Room 


In Same Room 


First grade 


52 
21 

20 

6 

IS 

7 



72 

57 
59 
42 
62 


Second ccrade 


Third irrade ...... t . r 


Fourth grade 


Fifth srade 


Sixth irrade 


19 

4 


Seventh srade 




Total 


Z2I 


315 





TABLE Vm 
Special Demotions to Lower Classes 





In Another 
Room 


In Same Room 


First grade 


60 
28 

38 
10 
22 

17 

zz 


70 


Second erade 


29 
34 
24 
32 

34 
II 


Third srade 


Fourth srade 


Fifth giade 


Sixth srade 


Seventh srade 






Total 


z86 


234 





While these summaries indicate that nearly all the pupils of the 
schools are moved forward in mass, it is very probable that the oppor- 
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tunity for individual adjustment is somewhat greater than is here indi- 
cated, for two reasons: First, the form of report used was new and in 
several cases it was evident that errors had been made, and the reports 
were returned for correction. However, in other cases the reports may 
not have been understood and errors may have been made. Secondly, 
the most probable form of error would be a failure to report special pro- 
motions and demotions by oversight or because of failure to keep a record 
of all such cases. 

While the majority of pupils are average pupils and should move in 
masSy there is a considerable number of especially slow pupils and also of 
especially bright pupils that should not be sacrificed to mass movement. 

It is very comforting to note that the figures given above show i6 
more special promotions than special demotions. This means that the 
bright children are being given a chance. The bright children need 
special opportimities for advancement as well as the slow children. 

The problem of meeting the needs of the individual pupil in dty- 
school systems is still an imsolved one. It baffles both teachers and 
school administrators. One forward step has been made in that the 
problem has been recognized. For years teachers and school superin- 
tendents refused to admit the existence of such a problem. Some 
progress is being made in the solution of the problem through super- 
vised study hours, special-help periods, more individual instruction, and 
less mass teaching. 

D. EFFICIENCY OF SCHOOL WORK 

In measuring the efficiency of teaching, the median results for the 
entire dty were computed. These results were furnished to each prin- 
cipal and thus it was possible for a principal to compare each room in 
his building with the dty medians and determine where added emphasis 
was needed or where improved methods were needed. In handwriting 
a test was made and the following directions were given the pupils in 
October: 

Public Schools, Ejvnsas City, Missouri 

pupil's direction 

Write as well as you can at your usual speed the following stanza. Write 
the stanza again and again until I say "Stop." At the command, stop at 
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once, even if in the middle of a letter. Use a line of paper for each line of 
stanza. Use no punctuation marks. 

Speak the truth 

In the end it shall appear 

Truth is best in age and youth 

The teachers and principals were directed to have each pupil read this 
stanza twice before beginning to write, to have the pupils write exactly 
two minutes, and to have no writing on the papers except the stanza — 
no name, no grade, no school, and no nmnber. The samples in each 
building were collected by rooms and grades, and each bundle was 
properly labeled. These samples were then given key-nmnbers, and 
put up in bundles of 150 to 200 papers each, and assigned to about one 
hundred teachers who were especially good in handwriting, who volun- 
teered to score the papers by the Thomdike scale. When these papers 
were returned and the scoring studied, it was found that the standards 
of the scorers, even when the scale was used, were so different that the 
comparisons of rooms or buildings would be worthless. Then it was 
determined to take a group of normal-training-school students and train 
them to use the Thomdike scale. Twenty of these students were chosen. 
The material used was that devised by Dr. E. L. Thomdike and described 
in the Teachers College Record for November, 1914. The standard speci- 
mens were graded independently by the normal students on eight differ- 
ent days. After each grading a conference was held and specimens that 
were not accurately graded were studied more closely. Freeman's 
suggestions on grading handwriting were also read by the students. 
Although no effort was made to follow the Freeman plan, yet it perhaps 
had some influence in their grading. The standard specimens were cut 
apart, their nmnbers concealed, and then the specimens graded. Also 
at these daily conferences twenty samples of the students' writing were 
nmnbered serially and were graded by each of these normal students, 
and the twenty students then compared their results on each of these 
specimens. In this way, in about two weeks they became so skilful that 
they varied only 3 to 5 per cent on a group of twenty papers. This 
body of twenty students then for a small stipend graded 57,863 
writing samples. The ranges and medians for the dty are given in 
Tables EX-XI. 
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Mr. Freeman's standards (Table XII) are for an eight-grade S3rstem. 
For the Elansas City schools with a seven-grade system the standards 

TABLE DC 
Ranges in Class Medians in QnALiTY-HANDWxmNO 



Grade 


October 


May 


M-O 


H 


vn 


8.I-II.S 
7.9-II.2 
7.S-IO.3 

75- 9.7 
6.8- 9.6 


8.4-14.0 
8.2-II.9 
7.S-II.0 
7.I-IO.9 
6.8- 9.9 
59- 90 


8.5-14.0 
8. 2-14. I 
7.1-11.6 
7.1-10.1 
7.0-10.0 


8.8-13.8 
8.5-13.2 
8.3-12.0 
6.3-12.2 
6 8-11 I 


VI 


V 


IV 


Ill 


n 


6 2—10 I 


I 






55- 9.3 











October ■•October papers. 

M^ * Blay papers. 

M-0 "M^ papers ol the same pupils that were in these grades in October. 

H*Special papers collected by the writing supervisor. 

TABLE X 
Ranges in Class Medians in Speed-Handwsiting 



Grade 



vn 

VI. 

v.. 

IV. 

m. 
n.. 



October 



17.5-II9.O 
34.0- 93.0 
21. 5-107.0 
II. 5- 83.0 

14-5- 63.5 



May 



SO 

35 

49 

39 
29 

IS 



S-118.0 
S-iii.o 
S-100.5 
o- 91.5 
5- 69.0 
5- 78.0 



M-0 



SO 

3S 
SO 
44 
30 



S-118.0 
S-10S.5 

s- 99.0 

5- 81.0 

s- 83.0 



TABLE XI 
Class Medians in Handwxiting 





Quality 


Speed 


Gkade 


October 


M-0 


Gain 


H 


October 


M-0 


Gam 


vn 


9.S 
9-1 
8.7 
8.2 

8.0 


10.6 

9.9 
9-4 
8.8 
8.2 


I.I 
0.8 

0.7 
0.6 
0.2 


II. 4 
II. 

10.5 

8.4 
7.6 
7.2 


72 

65 
60 

49 
3S 


77 
76 
69 
64 
S3 


S 
II 


VI 


V 


9 

IS 
18 


IV 


m 


n 




I 
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of Table Xm are proposed. It is to be noted that the quality suggested 
for the seventh grade is only 12. These standards are for the quality 
of work at the end of the year. A pupil who on completing the sixth 
grade writes quality 11 . $ on the Thomdike scale at the rate of 80 letters 
per minute has reached the sixth-grade standard in writing. 

TABLE Xn 

Fxeeman's Proposed Stamdasd for Quality and Speed in Handwritino 
(The quality is converted into units of the Thomdike scale instead of the Ayres' units) 



• 


School Grade 




n 


III 


IV 


V 


VI 


vn 


VTII 


Quality 


8.0 
36 


8.4 
48 


91 

56 


10. 
6s 


10.7 

72 


II. 6 

80 


12.7 
90 


Speed 





TABLE xm 
Proposed Standards for Kansas City Schools— ^peed and Quauty 





School Gkade 




n 


III 


IV 


V 


VI 


vn 


Quality 

Speed 


75 
36 


8.5 
48 


95 
60 


10. 5 
70 


"5 
80 


12.0 
90 



That these standards are easily attainable is indicated by the fact 
that in May the six rooms doing the best work in each of the various 
grades of the city averaged o. 6 of xt Thomdike point above the standard 
in quality proposed, and also averaged 21 letters per minute above the 
standard in speed. Even in October, the six rooms doing the best work 
averaged only o. 5 of a Thomdike point below the proposed quality, and 
the average speed in October of these rooms was 10 letters per minute 
above the standard. It is not expected that every pupil in a room will 
reach the standard set, but the majority should readi the standard, and 
the higher the quality of teaching, the fewer will be the exceptions. The 
standard quality and speed should be maintained in all written work. 

Good teaching and good grading keep pupils of like ability together. 
When a pupil reaches the standard in writing for his grade, he may give 
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his attention to other studies. The presence in a room of a few especially 
good writers is no guaranty of good teaching. They are usually natural 
exceptions. In some cases, indeed, they are actually the products of 
poor teaching — the kind of teaching that takes care of the promising 
pupils to the neglect of the remainder. 

In October, 1,743 of the writing papers were worth 12 or more; this 
was about 11 per cent of the whole nimiber of papers graded. At the 
same time 2,076 pupils wrote more than 90 letters per minute. It is a 
waste of time to require pupils who can write quality 12 at the rate of 90 
letters per minute to continue practice in writing. The sixty hours of 
school time usually devoted to writing each year should be devoted to 
other work by pupils who have reached the standard. All attempts to 
train beyond a reasonable standard result in much waste of time and 
energy. Of the special papers prepared for Mr. Holt in May, 3,650, or 
about 18 per cent, were graded 12 or above. These people are doing 
satisfactory writing, and 2,400 of these pupils are below the seventh 
grade. It is pos^ble that the high quality of these papers was obtained 
at the sacrifice of speed. 

These facts show conclusively that there are large nmnbers of the 
elementary-school pupils who write well and rapidly. A school system 
should be judged, not by its best nor by its poorest product, but by its 
average product. The average writing product in the Elansas City 
schools, while comparing very favorably with the average product in 
other systems, is not quite so good in quality or in speed as it should be. 
With definite standards to be reached and close supervision by the writ- 
ing supervisor, in a year or two at most the standards proposed should 
be reached by practically all rooms. In fact, a few entire school build- 
ings have now reached the standard. Some buildings last year gained 
nearly 2 Thomdike points between October and May. However, the 
standard calls for only i point advance each year. Hence, schools below 
standard should be able, by extra effort, to advance to standard. 

Mr. Freeman, in discussing his proposed standards in handwriting, 
says: 

The data which have been presented indicate that this standard can be 
attained with an expenditure of time of not over 75 minutes a week. The 
writer is conviQced on the basis also of some of the data that it could be 
attained generally, as it is in some cases, by the expenditure of a much shorter 
amount of time. When the most efficient methods are employed, it will 
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probably be found that the expenditure of from ten to fifteen mmutes in the 
intermediate grades suffices to fix the handwriting habit in its main outline, 
and that the expenditure of a small amount of time in the upper grades will 
maintain the efficiency of the habit and increase it by the amount of progress 
which is represented in the standard. 

From the investigations made thus far I am of the opinion that gen- 
erally, not only in Kansas City, but in other cities, too much emphasis 
is placed on writing in the lower grades. With well-directed work in 
Grades HI, IV, V, writing can be fairly well mastered. Increased speed 
and improved quality in the sixth and seventh grades will come with 
very little practice — one or two ten-minute periods per week — ^if right 
habits have been established in the intermediate grades. 

Rooms below standard are advised to make an ''extra eSort" on 
penmanship. This does not mean additional time, but better methods 
of teaching, more specific and purposeful drills, a closer study of the 
needs of the dass, the elimination of waste, and more corrective indi- 
vidual work. Without doubt ample time is spent in the teaching of 
penmanship in all the grades and too much time in some grades. 



CHAPTER Xn 



»¥▼ 



THE EFFECTS OF EFFICIENCY TESTS IN READING ON A 

CITY SCH00L:SYSTEM 



E. E. OBERHOLTZER 
Superintendent of Schools, Tulsa, Oklahoma 



At the request of the committee the following brief statement is 
made of the effects of a series of tests in reading on the teachers and 
administrators of a school system. It is not the purpose of this paper 
to repeat the tables showing the nimierical results of these tests, but 
rather to comment briefly on the significance of the tests for the system 
of schools. 

In the beginning the teachers were somewhat skeptical as to the 
purpose of the tests. Some thought that it was an attempt to check 
up the work of the mdividual teacher as a basis for determining his or 
her efficiency. There was no large amount of experience in the system 
itself in the giving of tests or in the evaluating of results. The selection 
of the subject to be investigated was determined in part by the interests 
of the supervisors and in part by the suggestions derived from earlier 
scientific studies on reading. 

After a nmnber of conferences between the superintendent and the 
supervisors of the system, the following program was adopted as a suit- 
able one for a series of tests: (i) to ascertain the rate of reading, both 
oral and silent, as it is now taught in this system of schools; (2) to ascer- 
tain the relation that the rate of reading of one grade bears to its next 
higher grade as a standard of advancement; (3) to ascertain what factors 
are of greatest influence in affecting the rate of reading; (4) to ascertain 
the relation that the rate of reading bears to the result achieved in the 
process of reading considered as a thought-getting process. 

The inunediate result of the tests was to call the attention of the 
teachers to many problems of method which had heretofore entirely 
escaped their attention. Their original notion was that the way to 
teach reading is to read, read, read. The moment they began to per- 
form these tests, it became evident to them that the child, in learning to 
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read, is facing a multitude of difficulties without being guided by any 
de£biite notion of how to proceed. In fact, they learned that it is 
important for the teachers, as well as for the students, to make dis- 
tinctions that heretofore had escaped their attention. This is well 
brought out in the following quotations from individual grade teachers: 

1. ''We do not know how to teach silent reading." 

2. ''We had not realized the importance of efficiency in silent reading as 
related to the rest of the subjects." 

3. "We are going to emphasize silent reading and the grasp of content." 

4. "We will not teach oral reading less, but silent reading more." 

5. "The problem is ours. We will assist in its solution." 

6. "We have a new interest in teaching reading." 

A brief summary may be given of the general and specific results 
which came from the series of tests. 

GENERAL 

1. The attitude of pupil and teacher toward the subject changed. 

2. The utility of silent reading stressed. 

3. Greater emphasis placed on the proper method of presenting and 
conducting reading-lessons, especially so far as the rate of reading and 
the grasp of content are concerned. 

4. Closer correlation of reading with the other subjects. 

SPECIFIC 

1. A more definite standard for judging the efficiency of reading. 

2. A more elastic system of promotion by subjects. 

3. Closer attention to the individual differences of pupils in reading 
ability, thus adapting more closely the type of training to the individual 
pupil. 

4. A greater economy of time effected in teaching the subject. 

5. Greater intelligence and interest in the use of standards and tests 
in judging results of teaching. 

Perhaps many of these results may seem to the reader overstated. 
However, great care has been taken in the formation of these judgments 
to ascertain and formulate premises based upon the direct experience 
of teachers who are daily presenting the work in the classroom. The 
results seem to indicate that the study has been very beneficial in 
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achieving higher quality of teaching, not only in reading but in other 
subjects as well. 

At the time of writing this article teachers of the English depart- 
ment in the high school (unsolicited) brought the report that pupils in 
the language department showed much greater preparation than in 
former years. This improvement in language is believed to be in part 
due to the emphasis on the reading work of the elementary schools. 

This, with other evidences, seems to justify the belief that the school 
system itself has been greatly improved through the interest aroused in 
this study. Let me mention especially four ways in which the entire 
system is affected: 

1. A more scientific attitude and method in the subject is established. 

2. A closer checking-up of results is obtained. 

3. More definite teaching is practiced. 

4. More efficient learning results. 



CHAPTER Xm 

INVESTIGATION OF SPELLING IN THE SCHOOLS OF 

OAKLAND, CALIFORNIA 



J. B. SEARS 
Leland Stanford Junior University 



An extensive investigation of the subject of spelling was made in 
the Oakland schools during the past year, covering Grades U-VIII 
inclusive, in forty of the forty-one schools of the city. In addition to 
an examination of the general administrative policy affecting spelling, 
the schedules of time-allotment, the content of the course, lesson- 
assignments, and methods and devices in use in the classrooms, a test of 
the efficiency of spelling was made by the use of the Ayres Springfield 
lists.^ The tests were applied to 12,985 children." 

The tests were all given on the same day, to the younger children in 
the forenoon, and to the older children in the afternoon. The words were 
pronounced in the usual way by the classroom teacher, in the presence of 
a member of the investigating staff (some fifty advanced students of 
education had been carefully instructed for this purpose). The words 
were marked, partly by students, and partly by principals and teachers. 
No principal or teacher marked papers from his or her own school. 

The purpose of the study was to get together the facts necessary 
as a basis for a scientific handling of this branch of the curriculmn, to 
interpret these facts in the light of sound principles of administration, 
supervision, and teaching, and to make the results available for study 
by those engaged in supervising or teaching the subject. 

The results of the tests were expressed in terms: first, of group 
averages; secondly, of the distribution of individual scores within these 
groups; thirdly, of individual differences due to (a) age, (b) sex, and 
(c) general ability (teacher's estimate); fourthly, of social differences 

' These lists have since been embodied in a complete spelling scale. See Leonard 
P. A3rres, MeasuremefU of Ability in SpdUng. New York: Russell Sage Foundation, 

1915. 

' The full report is published by the Oakland School Department as Publication 

No. I of the Bureau of Liformation, Statistics, and Educational Research, June, 1915. 
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due to {a) father's occupation, (J) father's nationality, (c) the child's 
occupational ambition, and {d) the child's home language; fifthly, of 
the relation between tin^e-allotment and spelling ability. 

In terms of the standard (70 per cent) the averages for the city as 
a whole, for all but three of the separate schools, for all grades but 
second and third, rank high. The average score for the dty is 76 . 5 
per cent. The difference between averages attained by different schools 
is wide; the higher scores are attained by the larger schools. In some 
schools grade averages vary but slightly, while in other schools such 
variation is extremely wide. Also, when the scores of all the children 
in the dty are averaged by grades, these averages vary as much as 24 
per cent, and the variation of class averages within a given grade is even 
wider still, while the distribution of individual scores within a class, a 
grade, or a school, ranges from zero to perfect. And since 21 per cent of 
all the children in the dty made perfect scores, it is evident that the test 
was inadequate. 

The overlapping between grades and the wide difference between 
scores attained by different schools and by different grades show that 
there is no common standard for promotion in this subject. 

Inddent to the study of scores in the light of individual differences 
the schools were found to be over 60 per cent retarded. Every grade 
contained children at least eight years apart in ages, and a careful study 
showed that the accelerates invariably scored higher than their grade 
averages, while retardates regularly fell below, and the more retarded 
the lower their scores. 

The influence of sex, while not pronounced, is fairly constant, with 
a tendency to increase with age. And the correlation between general 
ability (teacher's estimate) and ability to spell is constant and marked. 

Differences between the scores of different social groups, as indicated 
above, appear, but they are not pronounced, and the effect of the home 
language, either as to extent or tyi^t of errors, is practically negligible. 

There is no evidence in the results of the tests, nor in other informa- 
tion gathered, to show that spelling is standardized in respect to content, 
method, length of lesson-assignment, time-allotment, or amount to be 
learned. From the standpoint of group averages the schools stand high, 
but from the distribution of individual scores it is evident that important 
individual and social differences do not enter as determining factors in 
the organization and teaching of the subject. 



CHAPTER XIV 

STANDARD TESTS AS ATOS IN THE CLASSIFICATION AND 

PROMOTION OF PUPILS 



DANIEL STARCH 
Assistant Professor of Psychology and Education, University of Wisconsin 



The two chief sources of waste in education are (i) teaching things 
that the bright pupils ahready know and (2) teaching things that none 
of the pupils need to know. Economy in the latter will be achieved by 
ascertaining what the really essential and important things in each sub- 
ject are. Economy in the former will be achieved by classifying and 
promoting pupils, not according to time, but according to ability. 

One third of the pupils waste time by being in classes in which they 
know practically all the material that is being covered in the recitation 
period and are able to perform all the tasks expected of them. Another 
third of the pupils waste time by being in classes in which they can grasp 
very little of the material and are able to perform very poorly, or not 
at all, the tasks expected of them. 

One pupil out of every three is promoted too slowly and one pupil 
out of every three is promoted too rapidly. One pupil in every three 
could finish the eight grades in seven years or less, and one pupil in every 
ten could finish the eight grades in six years or less. The reason for this 
situation is that the schools do not know in any accurate way the actual 
abilities of their pupils and are unable to compare in any precise manner 
the abilities of the pupils with one another. The result is that there are no 
definite, tangible standards with which the pupil of any given grade can 
be compared so as to ascertain whether he is up to the standard or not. 

I shall now attempt to show by concrete examples the basis of these 
assertions and the means by which a more accurate classification of the 
pupils may be brought about. 

Standard tests in reading, writing, spelling, and arithmetic were 
carried out in an elementary school in Madison composed of approxi- 
mately 350 pupils. The results of these tests are shown for each subject 
and for each grade by the distribution-curves in the following figures. 
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Let us examine first the perfonnance of the pupils in writing. The 
tests were designed to measure speed and quality of writing and were 
performed according to the specifications published by the writer in 
the Journal of Educational Psychology, February, 1915. The speed 
of writing was expressed in terms of the number of letters written per 




10 



II 



13 



S 7 5 9 

Chart I. — Distribution of pupils in writing in Grades I-Vm. The numbers 
along the base-line are the scores expressed in tenns of the Thomdike scale. 

minute, and the quality was measured by the Thomdike scale. By 
a process of equating speed and quality so as to express a pupil's writing 
ability in a single score, all the results were evaluated and represented 
in the curves of Chart I. The numbers along the base-line from left 
to right are qualities on the Thomdike scale. The distances vertically 
above each base-line represent the number of pupils. Thus it will be 
seen that the pupils in the first grade range all the way from quality 4 to 
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quality 9, and the pupils in the second grade range all the way from 
quality 6 . 25 to quality 9. The striking fact is the enormously wide range 
of abilities in each grade and the resulting overlapping of the abilities 
of one grade over those of the other grades. By actual computation, 
32 per cent of the pupils in any given grade equal or exceed the median 
of the next grade above it. A corresponding percentage of pupils 
equals or falls below the median of the next grade below. 

The tests in reading were designed to measure speed and compre- 
hension and were made according to the specifications published by the 
writer in the Journal of Educational Psychology, January, 1915. The 
reading ability of each pupil is represented by a single score in which his 
performances in speed and in comprehension are combined. The results 
are shown in Cluut 11 in a manner similar to that met in Chart I. The 
facts for reading are similar to those for writing. The range of ability 
in each grade is enormously wide, and the overlapping is likewise exten- 
sive. In the case of reading,3i per cent of the pupils in any given grade 
reach or exceed the median of the next grade above. 

The tests in spelling were made with the lists published in the 
Journal of Educational Psychology, March, 1915. The distributions 
and overlappings, as shown in Chart m, are in all essential respects 
identical with the two preceding tests. Twenty-three per cent of the 
pupils of any given grade reach or exceed the median of the next grade 
above. 

Ability in arithmetic was measured by means of the Courtis tests, 
Series A. It was foimd that 32.5 per cent of the pupils in any given 
grade reach or exceed the median of the next grade above. 

The question which now arises is this: Would not the range of ability 
and the overlapping be very much less if each pupil's performance in 
all studies were combined? Thus, a fourth-grade pupil might write 
as well as the average seventh-grade pupil and read as well as the 
average fifth-grade pupil, but spell no better than the average first- 
grade pupil. His average performance in all studies combined might be 
approximately what it should be for the fourth grade. 

What are the actual facts? A combined score for all studies was 
computed for each pupil, so that the various subjects were balanced 
against each other. It was foimd that even then the overlapping was 
practically as large. Thirty-two and two-tenths per cent of the pupils 
in any given grade reach or exceed the standard of the next grade above 
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it; thirty-five and two-tenths per cent fall to or below the standard of 
the next grade below. The schools have not been able to measure in 
any accurate manner the actual abilities of the pupils, nor to compare 
them with any objective standards. 




I.O 



3.0 



3.0 



4.0 



S.o 



6.0 



Chakt n. — ^Distribution of pupils in reading in Grades II-Vlll. (The numbers 
along the base-line are the scores in which speed and comprehension are combined, 
but expressed in terms of words read per second.) 



It is obvious that a considerable economy in time could be effected 
by classifying and promoting pupils according to their actual abilities 
or performances in the various studies. One-third of the pupils are one 
or more years ahead of the grade in which they are placed and could, 
therefore, complete the elementary school one year earlier and be fully 
up to the standard of the average eighth-grade pupil. 
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Grade 8 - 



aA 



Grade 7 ^ 



..M 



Grade g ^v 




Grade 5 j>. 



^vA/X. 




Grade 4 



.^/WX^ 



Grade 3 




Grade 2 



I 



lo 36 43 58 74 90 

Chart HE. — Distribution of pupils in spelling in Grades n-Vm. (The numbers 
along the base-line represent the percentage of words spelled correctly in the 
specified lists.) 
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Every school system ought to have a department of testing by means 
of standard scales and tests, so that the actual abilities and achieve- 
ments of pupils could be rated accurately and made use of in classifi- 
cation and promotion. The principle of promotion according to ability 
rather than according to time would also have the advantage of acting 
as an incentive to the pupils to do their best. 
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|The object of mental tests, practically considered, is to secure by 
a relatively refined and precise method a more accurate determination of 
the mental traits or the general mental status of a pupil than can be 
secured by other methods, as by inspection of his marks or his school 
progress or by the teacher's personal estimate. Roughly speaking, the 
mental tests now available for use with school children are of two sorts: 
first, those which aim to determine with some precision the presence 
or the absence or the amoimt of some specific mental characteristic, 
e.g., tests of memory-span, of quickness of learning, of pitch discrimina- 
tion, of color-blindness, etc. ; secondly, those which aim to determine with 
perhaps somewhat less precision the general status of the child's intel- 
ligence, his mental level or general all-roimd ability as related to that 
of other children of the same nationality, sex, age, and social status. 
In this second field the Binet-Simon tests have received such prepon- 
derant emphasi3 and attention as to constitute at i^resent almost the 
only system of tests of general intelligence with which the educational 
public is acquainted. 

In principle, the first sort of tests — those which bring to light specific 
mental abilities — are of most decided interest and importance for the 
work of the schools. In practice, they have received almost no atten- 
tion from school men, and it is impossible because of that, and more 
especially because they necessitate the participation of an investigator 
who possesses special training in general, experimental, and applied 
psychology and a good acquaintance with schoolroom problems, to urge 
at this time any wholesale adoption of them in public-school systems. 
What we should urge is that, in those school systems in which the condi- 
tions are favorable for the development of educational research, there 
should be created the office of consulting psychologist and that this official 
should be commissioned to make intensive studies of all sorts of special 
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cases in which the analysis of mental abilities and disabilities would 
throw light upon the means of instruction that would accomplish 
maximal results for school progress. There is no school system of any 
size that does not contain dozens and scores of pupils who present special 
psychological problems. Examples are: pupils that cannot learn to 
spell, pupils that have special difficulty in committing to memory, 
pupils that are slow in acquiring the technique of reading, pupils that 
display exceptional gifts in special lines of work, pupils that seem to be 
tone-deaf, pupils that present peculiar and seemingly inexplicable resist- 
ance to disciplinary control, pupils that exhibit speech disorders 
developed from compulsory right-handedness. In fine, the painstaking 
scrutiny and intensive study of all individuals that exhibit striking 
peculiarities in their mental equipment is a form of educational research 
that is greatly to be desired, that some of our best-equipped school 
systems could readily afford, and that demands for its prosecution the 
application by an expert of niunerous special forms of mental tests. 

Tests of the second sort — test-systems designed to measure general 
intellectual status — ^have come into considerable prominence in the past 
decade through the interest developed by the Binet-Simon tests. These 
tests were first proposed in 1905 by the eminent French psychologist, 
Alfred Binet, and his collaborator, the physician. Dr. Simon, in response 
to an inquiry as to what devices might be used to segregate, for placing 
in special classes, pupils too defective mentally to profit by instruction 
in regular classes. This preliminary statement was replaced in 1908 by 
a more systematic formulation and this 1908 series was again replaced 
three years later by what is known as the 191 1 revision. The extraor- 
dinary cleverness with which they were devised, the novelty of the 
principles they embodied, and their surprisingly satisfactory outcome 
from the schoolman's point of view, all conspired to focus upon these 
tests the active attention of psychologists and educators in all civilized 
countries. The extent of this activity may be gauged by the niunber of 
titles, 254, in the Binet-Simon bibliography published by Kohs in 1914. 
One consequence of this activity has been a flood of criticism, both 
constructive and destructive, which renders anything like an authori- 
tative standardization of every detail of procedure in the application 
of these tests quite out of the question at the present time. Fortunately, 
however, from the immediately practical point of view, it is imnecessary 
to go into these technical details of criticism. 
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This report, then, will be limited to demonstrating by reference to 
several typical studies in American cities that the Binet-Simon tests are 
valuable devices for the administration and organization of school sys- 
tems, to pointing out certain limitations in the tests, and to suggesting 
certain precautions that should be observed in their use. 

As typical studies of the usefulness of the tests in this coimtry we 
shall dte those by Goddard' (191 1), Dougherty (1913), Adler (1914), 
Brigham (1914), and Hicks (1915). 

Goddard reports upon the testing of all the pupils (2,000) of the 
public schools of Vineland, New Jersey, wherein it was foimd that 78 
per cent of the pupils were "normal," in the sense of being either "at 
age," one year "advanced," or one year "retarded" when their mental 
is compared with their chronological age. Pupils testing two or three 
years behind their age, 15 per cent of the school population of the 
first six grades, are regarded as "merely backward," and as needing to 
be placed in special classes in order to profit adequately by instruction. 
Pupils testing four or more years behind their age (3 per cent of these 
were found) are ranked as feeble-minded. Particular attention is called 
to the equally serious misfits on the other side of the curve of distribution, 
i.e., to those gifted children who are not placed in the school grade which 
their mental attainments indicate. "Nothing could be clearer," says 
Goddard, "than the way in which these figures [referring to one of his 
tables] demonstrate what we all know from experience must be true, 
that is, that we drag the dull child up, trying to keep him up to his grade 
and hold the bright child back to keep him to the same grade, thus doing 
gross injustice to both." The following excerpts from his results are 
sufficiently t3^ical to show what amoimt of disparity exists between the 
actual grading of children and the grading indicated by the Binet tests. 





Number 


Percentage 


In grades above what Binet scale would warrant 


131 

SS8 


9.4 
43.2 
43-2 


In grades correspondkig to what Binet scale would warrant. . 
In grades below what Binet scale would warrant 





The question at once arises: How far should the school be expected 
to show conformity to the Binet results in its grading ? To this we may 
return later. Suffice to say that after all allowance is made, there 

' Consult the references at the end of this chapter for sources. 
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remain many cases in which pupils are wrongly placed, and that the 
Binet scale offers one method of bringing the discrepancies to light. 

In 1913 Miss Dougherty reported upon the results of Binet tests 
applied to 483 pupils of the public schools of Kansas City, Kansas, 
whose ages ranged from six to seventeen years and whose school grades 
ranged from the first to the eighth. While expressing the hope that the 
scale may be improved in certain details, this investigator quotes as 
directly applicable to her own results the following statement of Goddard 
(in the report above cited) : 

It is almost beyond the bounds of possibility that we should get such 
figures as are shown in this table [a general distribution of results] imless the 
figures upon which it is based are amazingly accurate, and if they are accurate 
it gives us a wonderfiilly valuable method of measuring our efficiency and our 
accuracy in the grading of children, and points out the possibility of great 
improvement along this line — ^much to the advantage of the children and the 
comfort of the teacher. 

Miss Martha Adler, assistant principal of Public School 77, New York 
City, reported in 1914 the results of two experiments upon the classi- 
fication of pupils on the basis of Binet testing. In her first experi- 
ment 80 first-grade boys were tested in the middle of the year and 
the 35 who stood highest were placed together as the advanced section, 
while the remainder formed the regular section. Both sections were 
then carried forward as fast as their abilities would permit. The result 
was distinctly better progress for both sections than under ordinary 
methods of sectioning, that is, on other bases than mental ability. Her 
second experiment dealt with 89 fourth-grade boys; the general plan 
was similar and the results were similarly striking. Miss Adler is con- 
vinced that the Binet tests are worth while, not only for the pupils, but 
likewise for teachers and supervisors. Her experiments are of interest 
because they demonstrate the utility of mental tests for the classifica- 
tion of '' normal" pupils into sections within the regular classes. On the 
need of such classification she says: 

Although a large majority of pupils enter school at six, a difference in their 
mentalities is manifest almost at the outset, and after a few weeks two or three 
groups are formed to provide for the different ^ades of intelligence. In other 
words, there are three classes in one class. Allowing for the most efficient 
instruction, and for a skilful use of that educational time-killer "busy work," 
we are nevertheless forced to admit that there is an incredible amount of time 
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wasted, and almost superhuman energy expended in attempting really to 
supervise two groups while teaching a third. In the higher grades the group- 
ing is usually done sparingly, because of the sheer impossibility of covering the 
mass of subject-matter laid down in any way except by class instruction. 
Subject-matter increases in importance as the child advances — ^in fact, we are 
too much bound by a curriculiun, and classifications, gradations, and groupings 
are made with reference to it, rather than with reference to the pupils. What 
we need is something which will increase the importance of the child's indi- 
viduality. 

In the same year, 1914, C. C. Brigham published results secured 
by applying the Goddard 191 1 revision of the Binet-Simon scale to 309 
pupils in the first six grades of the Princeton Model School. Brigham 
concludes that the scale not only graded accurately "in the long nm" 
pupils of from seven to eleven years of age (there were too few cases at 
six years to generalize from), but was also "an adequate measure of 
individual diflEerences at any of these ages." "This conclusion," he 
adds, "may be qualified by defining 'accurately measured' as a correct 
measure 96 per cent of the time, but there is strong probability that this 
measure approached complete accuracy." 

During the past year, 1915, Vinnie C. Hicks, consulting psycholo- 
gist of the Oakland, California, schools, has reported tests of all the 
children in a kindergarten of that city to discover whether the results 
showed a good correlation with the actual school progress of the children. 
Her final conclusion is that " the Binet tests given to entrants to the first 
grade would not result in any unjust labeling of them as mental defec- 
tives." On the contrary, "the most evident fault of the tests, if used 
as prognosticative of school progress, is over-optimism." Again she 
says: "The chief value of giving the tests would be in having them pro- 
ductive of proper distribution of entrants according to ability, into 
regular classes, classes for the slow but intelligent, special classes for 
the subnormal, expulsion [from the classes of the regular school system] 
for the feeble-minded." 

The foregoing citations from five studies in American public-school 
systems represent, it will be understood, only a fraction of the available 
material.' They are adduced here as being enough to demonstrate that 

' From Wallin, {Menial HeaUh of the School Child, chap, xviii) it appears that the 
Binet tests are in use in at least the following American cities: Albany, Allentown, 
Altoona, Auburn, Aurora, Baltimore, Birmingham, Bloomfidd, N.J., Buffalo, Cam- 
bridge, Camden, Chester, Cincinnati, Cleveland, Columbus, Dajrton, Detroit, Denver, 
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the Binet-Simon tests can be used to distinct advantage in the 
classification and grading of school children from the very first day of 
their work in the schools. It goes without saying that die use of the 
tests in this manner presupposes the actual organization within the school 
system of sections or groups of pupils classified in accordance with the 
tests. This is not the place to discuss the details of such organization, 
save to point out that every bit of the evidence indorses a plan of organi- 
zation which embodies more than two such sections of groups within 
each of the usual school grades. Eventually, we shall imdoubtedly 
seek to develop in all school systems at least four groups: the gifted 
group, the regular group, the slow group, and the group of moderately 
defective mentality. A fifth group — the mental defectives whose 
insufficiency is marked — ^will be relegated to special custodial institu- 
tions. This plan of organization will be recognized as essentially the 
one widely and favorably known as the Sickinger, or Mannheim, system, 
now in operation in Germany. 

Stress has been laid in the preceding paragraphs upon the adequacy 
of the Binet-Simon tests in the differentiation of "normal" children 
into groups of approximately similar mental abilities. If the tests 
are adequate for this differentiation, it follows, afortiort, that they are 
unquestionably adequate for the detection and segregation of the 
distinctly mentally defective group, including both the more serious 
cases that need institutional treatment and the less serious cases that 
need instruction in special classes in the public-school system. On this 
account no specific citations will be made here to the very extensive 
literature upon the use of the tests for organizing special classes for 
mental defectives, though this is the field in which the tests have been 
most often used and for which they were originally designed. 

It remains, now, to consider certain limitations of the Binet tests 
and to note certain precautions that should be observed in their use. 

Elizabeth, Englewood, Everett, Wash., Goldsboro, N.C., Grand Rapids, Hackensack, 
Harrisburg, Hibbing, Minn., Hoquiam, Wash., Houston, Jersey City, Lakewood, 
Ohio, Little Rock, Long Branch, Los Angeles, Lquisville, Maiden, Mason City, Iowa, 
Minneapolis, Montclair, Mount Vernon, Morristown, Muskegon, Mich., Newark, 
New Britain, New Brunswick, New Haven, New Orleans, North Bergen, N.Y., 
Newton, Oakland, Cal., Passaic, Perth Amboy, Philadelphia, Pittsburgh, Plainfidd, 
Princeton, Raleigh, Reading, Richmond, Rochester, N.Y., Saginaw, St. Louis, Schenec- 
tady, Somerville, Mass., Somerville, N.J., Spokane, Springfield, Mass., Toledo, 
Trenton, Washington, West Hoboken. 
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Every expert who has dealt with the tests has found points to be criti- 
cized in them. No one claims that they are ideal or even as perfect as 
might be from a practical standpoint. Nearly everyone agrees that the 
tests of the lower school ages — ^up to the eighth year — are too easy, and 
that those of the higher ages — especially above the eighth year — are 
somewhat too difficult. The composition of the several tests has been 
criticized freely: some of them are felt to depend too much on school 
training; some of them are quite certainly wrongly placed (even in 
Binet's 191 1 revision); others are condemned on the groimd that they 
offer a one-to-one chance of success by mere guessing; still others are 
admittedly difficult to score. Similarly, the composition of the series 
for the several years is open to discussion; need is felt for an extension 
of the series above twelve years, and possibly for the insertion of finer 
gradations in the lower years; the interpretation of the data, particularly 
when certain tests are missed in the earlier years and others passed in the 
later years, offers much chance for debate. These and other criticisms 
can be offered against the Binet scale. Nevertheless, they are sufficiently 
met for our present purposes by the one outstanding fact that the tests, 
even with these imperfections, do work. School men need not cast 
aside an educational device just because it is open to improvement. 

More important, in our opinion, than these details of improving the 
technique of the scale is the possible misinterpretation of what the tests 
really do for us. It should be understood, for example, that they do not 
pretend to afford a precise and comprehensive view of the mental apti- 
tudes of the pupil. They tell us merely that, taken as a whole, a given 
pupil can do approximately those things that most children of a certain 
age can do. But in another way, two pupils might both test eight years 
mentally and yet be very different from one another; an imbecile who 
tests eight years and who is actually twelve years old has quite a different 
mind after all from the normal eight-year-old child. 

Again, it is important not to forget that even if the tests should 
measure native ability ideally, still we should not expect a complete 
correspondence between the test results and school progress, for the 
fairly obvious reason that school progress depends on other factors than 
native ability. Industry and zeal, good home-conditions, docility, 
inclination for "bookish" pursuits, freedom from Ulness, conformity 
to the school routine, these and other factors play their rdle. The point 
is, however, that these conditions are relatively accessible to modification 
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and control, whereas native ability, in the nature of the case, is a 
primary and uncontrollable prerequisite for school success. It follows 
that the determination of the general intellectual status cannot be 
neglected, even though some pupils of moderate ability are able to get 
higher marks than other pupils of superior ability. 

In the actual administration of the Binet tests there arise several 
important questions. One of these, in particular, has aroused consider- 
able debate. Must these tests be administered by a specially trained 
expert or may they be administered by any classroom teacher? On 
this point there is disagreement. Our opinion is between the extreme 
views. We should recommend the employment wherever possible of 
an expert psychologist who has had experience, not alone in the psycho- 
logical laboratory, but also in the conduct of mental tests generally, and 
who is also familiar by personal contact with the various forms of mental 
deficiency to be foimd in institutions for the feeble-minded, who could 
qualify, in short, as an expert psycho-clinicist.' But, where circimi- 
stances prevent the employment of an expert psycho-cKnicist, we are 
of the opinion that selected teachers may be trained to perform the most 
necessary selection of mentally defective pupils with sufficient accuracy 
to warrant the adoption of this plan. We would recommend that these 
teachers should be able to present most, if not all, of the following 
qualifications: (i) at least a general familiarity with the classroom work 
of the grade schools, (2) a degree of general intelligence better than the 
average of elementary-school teachers, (3) familiarity with general 
elementary psychology, educational psychology, and, preferably also, 
experimental psychology, (4) familiarity with the main aspects of 
personal hygiene and of school hygiene (with special emphasis upon 
physical defects and their relation to mentality), (5) knowledge of the 
history, aims, methods, and results of the special classes for mentally 
defective children as operated in public schools, (6) special drill in the 
administration of mental tests, including the technique of the Binet 
scale, and knowledge of the principal proposals for its modification and 
extension, (7) personal observation of niunbers of feeble-minded children 

' The proper qualifications for psycho-clinical work have been set forth at length 
by J. £. W. Wallin, whose views may be taken as an example of those who would 
restrict diagnostic work with mental tests to persons of quite varied and exceptional 
training and experience. 
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as gathered in institutions for mental defectives.' Opportunities to 
secure this special training are now offered by a number of universities, 
particularly in their summer-school courses. It is also gratifying to 
note that several of the institutions for the care of the feeble-minded 
are opening their classes for observation and practice work to limited 
numbers of properly qualified teachers and supervisors of special classes 
for mental defectives. We would recommend that school boards directly 
or indirectly subsidize selected teachers to enable them to secure adequate 
training in this field. 

Another question often debated is: Which of the numerous formu- 
lations of the Binet tests should be used ? In our opinion, for the pur- 
poses of such classification as is here recommended, little or no difference 
will appear in the results from the use of different formulations. When 
the basal year is ten or over, we incline to favor the arrangement of the 
tests proposed by Kuhlmann or by Terman (known as the Stanford 
revision) rather than the earlier and more frequently used '^ standard 
method" published by Goddard, simply because a number of the modi- 
fications tentatively introduced by the last-named have been found to 
be undesirable. Yet the Goddard formulation has the merit of greater 
ease in handling and administering. It is, moreover, in more common 
use than the others. Its results are equally good for ages imder ten. 
The Teachers* Manual prepared by Professor R. A. Schwegler (14), and 
published by the School of Education of the University of Kansas, has 
also an excellent accoimt of this scale and a verbatim set of directions 
for its conduct. 

Whatever arrangement of the scale is used, there are certain general 
directions for testing that are important if standardized results are to 
be obtained. The following may be deemed especially essential: 

' These recommendations accord with the resolution adopted by the American 
Psychological Association, at its Chicago meeting, December, 191 5, deprecating the 
use of mental tests for purposes of practical diagnosis by persons psychologically un- 
qualified for such work. Since the purport of this resolution has been wrongly 
stated in certain newspapers, where it has been declared that the American Psycho- 
logical Association ''put its ban on the Binet tests," it would seem not inappropriate 
here to warn school officials against supposing that the Binet scale has been officially 
discredited by professional psychologists and against supposing that any person, 
regardless of training, is competent to apply the scale and either to commend or 
condenm it. 
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1. Isolation. — Conduct the test individually in a quiet, well-lighted 
room, free from interruption, and without the presence of parents, 
teachers, or other children. An assistant, who shall record all responses 
verbatim, may be used to advantage when time is to be economized. 

2. PreUminary observation. — ^Don't start the testing at once, but 
take a few minutes to get acquainted with the child and to disarm 
suspicion or timidity. We have fotmd it useful to measure weight, 
height, vital capacity, strength of grip, vision, and even hearing (quite 
roughly), and with yotmger children to try the form-board. These 
ph3rsical tests are directly interesting to the child and they often reveal 
to the examiner physical defects that accotmt for what seems to be mental 
insufficiency. Naturally, this preliminary observation must not be 
long enough to wear out the child before the Binet tests are begun. 

3. Encourage. — ^Avoid anything that suggests an inquisition. Never 
show impatience. Never ridicule. Be tactful and S3mipathetic. 
Never correct the child. Never state flatly that his answers are wrong. 

4. Avoid pumping. — ^Amateurs almost invariably read into the child's 
responses their own knowledge. In consequence, they proceed to 
^'pimip" the right answer out by hinting, suggesting, and quizzing: 
"You mean thus and so, don't you?" "Isn't it really this?" etc. 

5. Follow directions. — ^The besetting sin of the amateur tester is 
his proneness to modify the conditions of administering the tests. It 
cannot be said too emphatically that the primary rule in the use of mental 
tests is: " Follow directions." Put negatively, if the slang be permitted: 
"Don't monkey with your method." In especial, don't alter the 
instructions given to the child in the tests. 

6. Siddigkts. — ^Be on the watch for the niunerous indirect indications 
of the child's mental processes. To the skilful examiner the attitude 
and manner of the child will convey valuable hints supplementary to 
the actual replies. Make full notes on the record blank of these accessory 
symptoms of mentality. 

7. Order of tests. — ^Begin with a nimiber of relatively simple tests. 
The pictures and the definitions, for example, are always interesting 
and frequently supply the examiner at the outset with an approximate 
notion of the child's status. Do not follow strictly the order on the 
record blank. Intersperse difficult with easy tests. 

8. Range of testing. — ^The narrowest range permissible is from the 
lowest age at which all the tests are passed to the highest age at which 
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any single test is passed. If the results show considerable irregularity 
(much '' scattering ")y it will be necessary to widen this range. 

9. Recording. — ^If no stenographic or clerical assistance is feasible, 
make the attempt, nevertheless, to set down, as soon as it is made, a 
full record of the child's responses. It is impossible to fill these in later 
from memory. Moreover, it frequently becomes desirable to know 
afterward, not merely that the child passed or failed in a given test, 
but just precisely what his response was. 

10. Anamnesis. — ^It is usually worth while to record a tolerably 
fuU account of the child's personal history, since it is impossible to be 
sure that this information will not be wanted afterward in dealing with 
the case. The following items are recommended: {a) child's name in 
full, {b) sex, (c) date of birth, {d) name of school, {e) school grade, 
(/) date and hour of examination, (g) name of examiner, (A) name of 
person proposing the examination, (i) name of teacher, {j) names and 
addresses of parents, {k) occupation of parents, (f) niunber of children 
in family and their sex, (m) illnesses of pupil, (n) obvious physical defects 
or peculiarities, {0) conduct in school, {p) proficiency in school,(9) oth^ 
items pertinent to the child in question.' 
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463 PP- 
21. Whipple, G. M. Manual of Mental and Physical Tests. Baltimore, 2d 

ed., 1914 and 1915. Part I, Simpler Processes, 365 pp. Part II, Complex 

Processes, 336 pp. 



CONSTITUTION OF THE NATIONAL SOCIETY FOR THE 

STUDY OF EDUCATION 

(Revision Adopted in Chicago, Februaiy, 1909) 

ARTICLE I 

I 

Name, — ^The name of this Society shall be ''National Society for the Study 
of Education." 

ARTICLE n 

Olject, — ^Its purposes are to carry on the investigation and to promote the 
discussion of educational problems. 

ARTICLE m 

Membership, — Section i. There shall be three classes of members — 
active, associate, and honorary. 

Sec. 2. Any person who is desirous of promoting the purposes of this 
Society is eligible to active membership and shall become a member on approval 
of the Executive Committee. 

Sec. 3. Active members shall be entitled to hold office, to vote, and to 
participate in discussion. 

Sec. 4. Assodate members shall receive the publications of the Society, 
and may attend its meetings, but shall not be entitled to hold office, or to 
vote, or to take part in the discussion. 

Sec. 5. Honorary members shall be entitled to all the privileges of active 
members, with the exception of voting and holding office, and shall be exempt 
from the pa3anent of dues. 

A person may be elected to honorary membership by vote of the Society 
on nomination by the Executive Committee. 

Sec. 6. The names of the active and honorary members shall be printed 
in the Yearbook, 

Sec. 7. The annual dues for active members shall be $2.00 and for the 
associate members $1 . 00. 

ARTICLE IV 

Officers and CommUtees, — ^Section i. The officers of this Society shall 
be a president, a vice-president, a secretary-treasurer, an Executive Committee, 
and a Board of Trustees. 

Sec. 2. The Executive Committee shall consist of the president and four 
other members of the Society. 
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Sec. 3. The president, vice-president, and secretary-treasurer shall 
serve for a term of one year. The other members of the Executive Committee 
shall serve for four years, one to be elected by the Society each year. 

Sec. 4. The Executive Committee shall have general charge of the work 
of the Society, shall appoint the secretary-treasurer, and may, at its discretion, 
appoint an editor of the Yearbook, 

Sec. 5. A Board of Trustees consisting of three members shall be elected 
by the Society for a term of three years, one to be elected each year. 

The Board of Trustees shall be the custodian of the property of the So- 
ciety, shall have power to make contracts, and shall audit all accounts of the 
Society, and make an annual financial report. 

Sec. 6. The method of electing officers shall be determined by the Society. 

ARTICLE V 

Publications, — ^The Society shall publish The Yearbook of the National 
Society for the Study of Education and such supplements as the Executive Com- 
mittee may provide for. 

ARTICLE VI 

Meetings, — ^The Society shall hold its annual meetings at the time and 
place of the Department of Superintendence of the National Education Asso- 
ciation. Other meetings may be held when authori2sed by the Society or by 
the Executive Committee. 

ARTICLE Vn 

Amendments, — ^This constitution may be amended at any annual meeting 
by a vote of two-thirds of voting members present. 



MINUTES OF THE MEETING OF THE NATIONAL SOCIETY 

FOR THE STUDY OF EDUCATION AT CINCINNATI, 

OHIO, MONDAY, FEBRUARY 22, 1915 

An audience of some five hundred persons assembled in one of the ball- 
rooms at the Sinton Hotel in order to hear the discussion of Part I of the 
Fourteen^ Yearbook of the Society, while some two hundred persons were turned 
away, owing to the fact that the room was filled. This unusually large number 
was due to the fact that the Yearbook entitled Minimum Essentials in Elemen- 
tary School Subjects made such a wide appeal and to the fact that it represented 
the co-operative efforts of the National Society for the Study of Education 
and the Conunittee on Economy of Time of the National Education Association. 

President J. M. Gwinn called the meeting to order at 8:00 o'clock, and 
presided during the progress of the following program: 
Topic: ''Minimum Essentials in Elementary-School Subjects." General 
Statement of the Scope of the Yearbook. 

J. M. GwiNN, Superintendent of Schools, New Orleans, La. 
''The Essentials in Language and Literature" 

James Fleming Hosic, Head of Department of English, Chicago Normal 
College, Chicago, HI. 
''Objective Standards for Controlling Instruction and Economizing Time" 

S. A. Courtis, Director of Educational Research, Public Schools, Detroit, 
Mich. 
" Standard Requirements in Handwriting " 

F. N. Freeman, Assistant Professor of Education, University of Chicago, 
Chicago, HI. 

Discussion: 

G. D. Strayer, Professor of Educational Administration, Teachers 
College, Columbia University, New York, N.Y. 

F. E. Spaxtlding, Superintendent of Schools, Minneapolis, Minn. 

The report of the nominating committee was presented and the following 
officers elected: President, Superintendent R. J. Condon, of Cincinnati; 
Vice-President, Professor J. Carleton Bell, University of Texas; Member of 
Executive Committee for the term expiring in 1919, President Dwight B. 
Waldo, of the Western State Normal School, Kalamazoo, Mich.; Member 
of the Executive Committee to fill the vacancy caused by the resignation of 
Superintendent H. C. Morrison, Superintendent Harry B. Wilson, of Topeka, 
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Kan.; Member of the Board of Trustees, Professor S. Chester Parker, Uni- 
versity of Chicago. 

At approximately lo : oo o'clock the chairman adjourned the meeting, which 
had proved to be especially successful, largely owing to the fact that each 
speaker was thoroughly well prepared and spoke exactly the length of time 

that had been assigned him. 

S. Chester Paiueler, Secretary 
J. M. GwiNN, President 



FINANCIAL REPORT OF THE SECRETARY-TREASURER OF 
THE NATIONAL SOCIETY FOR THE STUDY 

OF EDUCATION 

December 23, 1914, to December 23, 1915 

RECEIPTS FOR I915 

Balance on hand December 23, 1914 liyOSy . 28 

From sale of Yearbooks by The University of Chicago Press: 
Jime to December, 1914 $347.49 

January to Jime, 1915 912-97 

$1,260.46 

Interest on savings bank accoimt: 

To January i, 1915 $ 12.98 

To July 1, 191S 6. 25 

19.23 

Dues from members (current and delinquent): 

Active $387.80 

Associate 219.30 

% 607 . 10 

Total income for the year $1,886. 74 

Total receipts including initial balance $2,974 . 07 

EXPEMDITUSES POR I915 

Publis/nng and distributing " Yearbooks**: 

Printing Fourteenth Yearbook, Part I ("Minimum Essen- 
tials") $499.69 

Dbtributing Fourteenth Yearbook, Part I, to members 35-54 

Printing 1,200 additional copies Fourteenth Yearbook, Part I 184. 50 
Printing Fourteenth Yearbook, Part II ("Teachers' Effi- 
ciency") 239. 19 

Distributing Fourteenth Yearbook, Part II, to members 25 . 13 

Printing 1,000 additional copies Twelfth Yearbook, Part I 

("Supervision of City Schools") 79.36 

Printing i ,01 5 additional copies Fourteenth Yearbook, Part II 76 . 10 

Miscellaneous expenses preparing Yearbooks 20. 13 

Distributing Yearbooks to members, miscellaneous 9. 77 

Total cost of Yearbooks $1,169.41 

Carried forward - 1,169.41 
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Brought forward $1,169.41 

Secretofy^s office: 

Secretaiy's salaiy from end of Richmond meeting, Feb- 

ruaiy, 1914, to end of Cincinnati meeting, February, 1915 $100 . 00 
Secretary's traveling and hotel expenses for Cincinnati 

meeting 49.10 

Typewriting 21.20 

Bookkeeping 31*25 

Stamps 30.00 

Stationery 17*85 

Telegrams 5.31 

Exchange 6.70 

Total for Secretary's office 261.41 

Total expenses $1,430.82 



SUMMA&Y 

Total expenditures for 1915 $1,430.82 

Balance on hand December 23, i9is< ^^^^^ '1 > 9 • 3 

^* ^ ^VChecking account 251.12 

Total $2,974.07 



Number of active members (including one honorary) December 

«3» 1915 195 

Number of associate members December 23, 1915 242 

Total membership 437 

Guy M. Whifplb, Secretary-Treasurer 



LIST OF ACTIVE AND HONORARY MEMBERS OF THE 
NATIONAL SOCIETY FOR THE STUDY 

OF EDUCATION 

(Corrected to January 15, 1916) 

HONORARY MEMBERS 

Dewey, John, Columbia University, New York, N.Y. 

ACTIVE MEMBERS 

Allen, Fiske, State Normal School, Charleston, HI. 
Arbaugh, W. B., Ypsilanti, Mich. 
Ashley, L. S., Sibley, 111. 

Axline, Howard E., West Technical High School, Cleveland, Ohio. 
Bachman, R. H., Tarboro, N.C. 
Bagley, William C, University of Illinois, Urbana, HI. 
Baldwin, Bird T., Swarthmore College, Swarthmore, Pa. 
Ballou, Frank W., care of School Committee, Mason St., Boston, Mass. 
Barnes, Harold, Girard College, Philadelphia, Pa. 
Becker, Ernest J., Eastern High School, Baltimore, Md. 
Bell, J. Carleton, University of Texas, Austin, Tex. 
Benedict, Ezra W., Principal of High School, Walden, Orange Co., N.Y. 
Blaine, Mrs. Anita McCormick, loi East Erie St., Chicago, HI. 
Bland, W. P., Superintendent of Schools, Globe, Ariz. 
Bolton, Frederick E., University of Washington, Seattle, Wash. 
Boyer, Charles, Superintendent of Schools, Atlantic City, N.J. 
Bradford, Mrs. Mary D., Superintendent of Schools, Kenosha, Wis. 
Breckenridge, Elizabeth, 962 Fourth St., Louisville, Ky. 
Briggs, Thomas H., Columbia University, Teachers College, New York, N.Y. 
Brooks, Stratton D., State University, Norman, Okla. 
Brown, J. C, University of Illinois, Urbana, HI. 
Brown, J. Stanley, Superintendent of Township High School, Joliet, HI. 
Brown, John F., 559 W. 156 St., New York, N.Y. 
Brumbaugh, Martin G., Harrisburg, Pa. 

Bryan, W. J. S., Assistant Superintendent of Schools, St. Louis, Mo. 
Buchner, Edward F., Johns Hopkins University, Baltimore, Md. 
Bumham, Ernest, State Normal School, Kalamazoo, Mich. 
Bush, I. B., Superintendent of Schools, Erie, Pa. 
Butterworth, Julian E., University of Wyoming, Laramie, Wyo. 
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Cammack, 1. 1., Superintendent of Schools, Kansas City, Mo. 

Chadsey, Charles £., Superintendent of Schools, Detroit, Mich. 

Chandler, J. A. C, Superintendent of Schools, Richmond, Va. 

Chapman, Ira T., Superintendent of Schools, Norwalk, Conn. 

Charters, W. W., State University, Colimibia, Mo. 

Childs, Hubert G., State University, Bloomington, Ind. 

Clark, W. A., 312 E. Jefferson St., Kirksville, Mo. 

Claxton, P. P., Bureau of Education, Washington, D.C. 

Clement, J. A., Northwestern University, Evanston, 111. 

Coffman, Lotus D., University of Minnesota, Minneapolis, Minn. 

Condon, Randall J., Superintendent of Schools, Cincinnati, Ohio. 

Conradi, Edward, Florida State College for Women, Tallahassee, Fla. 

Cook, Albert S., County Superintendent of Schools, Sta. A., Towson, Md. 

Cook, John W., President, Northern Illinois State Normal School, DeKalb, 111. 

Cooke, Flora J., Francis W. Parker School, 330 Webster Ave., Chicago, 111. 

Courtis, S. A., 82 Eliot St., Detroit, Mich. 

Cox, Philip W. L., Superintendent of Schools, Solvay, N.Y. 

Cramer, W. F., Superintendent of Schools, Atlantic, la. 

Cubberley, Ellwood P., Leland Stanford Junior University, Stanford University, 

Cal. 
Davis, B. M., Miami University, Oxford, Ohio. 
Davis, Solon P., District Superintendent, Henry Barnard School, Hartford, 

Conn. 
Deahl, Jasper N., University of West Virginia, Morgantown, W.Va. 
Dearmont, Washington S., President, State Normal School, Cape Girardeau, 

Mo. 
Dick, George S., President, State Normal School, Kearney, Neb. 
Doelle, John A., Superintendent of Schools, Houghton, Mich. 
Doyle, Mary E., 1009 60th St., Chicago, 111. 
Earhart, Lida B., 430 W. 118th St., New York, N.Y. 
Eby, Frederick, State University, Austin, Tex. 
Elliott, C. H., 527 W. i2ist St., New York, N.Y. 
Elliott, Edward C, Chancellor, State University, Helena, Mont. 
Ellis, A. Caswell, University of Texas, Austin, Tex. 
Elson, William H., Superintendent of Schools, Cleveland, Ohio. 
Ernst, L. R., Cote Brilliante School, St. Louis, Mo. 
Farrington, Frederick E., Teachers College, Colimibia University, New York, 

N.Y. 
Feeney, T. L., Miami University, Oxford, Ohio. 

Felmley, David, President, Illinois State Normal University, Normal, HI. 
Fleshman, A. C, 1937 South Grand Ave., Los Angeles, Cal. 
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Forbes, George M., 235 Dartmouth St., Rochester, N.Y. 

Foster, H. H., University of Arizona, Tucson, Ariz. 

Frederick, J. M. H., Superintendent of Schools, Cleveland, Ohio. 

Frost, J. M., Superintendent of Schools, Muskegon, Mich. 

Fuerst, Sidney M., 176 Amity St., Flushing, Long Island, N.Y. 

Gosling, T. W., Hughes High School, Cincinnati, Ohio. 

Greeson, William A., Superintendent of Schoob, Grand Rapids, Mich. 

Griffin, Margery M., 4045 McPherson Ave., St. Louis, Mo. 

Gwinn, J. M., Superintendent of Schools, New Orleans, La. 

Hall, John W., University of Cincinnati, Cincinnati, Ohio. 

Halleck, Reuben Post, Principal, Bo3rs High School, Louisville, Ky. 

Hamilton, Cora M., State Normal School, Macomb, HI. 

Harris, Ada Van Stone, 6216 Howe St., £.£., Pittsburgh, Pa. 

Hatch, W. H., Superintendent of Schools, Oak Park, HI. 

Heatwole, Cornelius J., State Normal School, Harrisonburg, Va. 

Heckert, J. W., Miami University, Oxford, Ohio. 

Henderson, Hermon C, State Normal School, Milwaukee, Wis. 

Herron, Helen, 1933 Elysian Fields Ave., New Orleans, La. 

Hill, Patty Smith, Teachers College, New York, N.Y. 

Hitchcock, Clara M., Lake Erie College, Painesville, Ohio. 

Horn, Paul Whitfield, Superintendent of Schools, Houston, Tex. 

Jeffers, Fred A., Superintendent of Schools, Painsdale, Mich. 

Jenks, Jeremiah W., New York University, Washington Square, New York 

N.Y. 
Johnson, Pliny, Woodward High Schools Cincinnati, Ohio. 
Johnston, Charles Hughes, University of Illinois, Urbana, HI. 
Jones, Arthur J., State University, Orono, Me. 
Jones, Lewis H., President, State Normal College, Ypsilanti, Mich. 
Judd, Charles H., University of Chicago, Chicago, HI. 
Kemp, W. W., University of Montana, Missoula, Mont. 
Kent, Henry L., Agricultural College, Manhattan, Kan. 
ELimball, J. F., Superintendent of Schools, Temple, Tex. 
King, John P., Superintendent of Public Schools, Union City, Ind. 
Kirk, John R., President, State Normal School, Kirksville, Mo. 
Kirk, W. H., Superintendent of Schools, East Cleveland, Ohio. 
Latham, R. H., Winston-Salem, N.C. 
Lattimore, J. C, Superintendent of Schools, Waco, Tex. 
Laurence, Isabel, State Normal School, St. Cloud, Minn. 
Lawson, W. C, Superintendent of Schools, Bryan, Tex. 
Lewis, Homer P., Superintendent of Schools, Worcester, Mass. 
Logan, Anna E., Miami University, Oxford, Ohio. 
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Lord, L. C, State Nonnal School, Charleston, HI. 

Lowry, Charles D., 1643 Kenilworth Ave., Chicago, HI. 

Lucas, Hardin, State Normal School, Valley City, N.Dak. 

Luckey, G. W. A., State University, Lincoln, Neb. 

Lukens, Herman T., Francis W. Parker School, 330 Webster Ave., Chicago, HL 

Lull, H. G., State University, Seattle, Wash. 

McAllister, Cloyd, N., Berea, Ky. 

McDanid, C. M., Superintendent of Schools, Hammond, Ind. 

McKenney, Charles, State Normal School, Ypsilanti, Mich. 

Mackey, £., Superintendent of Schools, Trenton, N.J. 

McMurry, Charles A., State Normal School, DeKalb, HI. 

McMurry, Frank M., Teachers College, New York, N.Y. 

Manny, Frank A., Teachers Training School, Baltimore, Md. 

Maphis, Charles G., University of Virginia, University, Va. 

Marrs, S. M. N., Superintendent of Schools, Terrell, Tex. 

Marsh, J. F., Assistant State Superintendent of Schools, Charleston, W.Va. 

Marsh, M. E., Berea College, Berea, Ky. 

Maxwell, William H., Superintendent of Schools, New York, N.Y. 

Mdcher, George, 9th and Locust Sts., Kansas City, Mo. 

Miller, Irving E., University of Rochester, Rochester, N.Y. 

Miller, James C, Department of Education, Edmonton, Alberta, Can. 

MiUs, Harriette M., New York University, Washington Sq., New York, N.Y, 

Minnich, H. C, State Normal College, Oxford, Ohio. 

Monroe, Edwin S., Superintendent City Schools, Muskogee, Okla. 

Monroe, Walter S., Kansas State Normal School, Emporia, Kan. 

Morgan, O. S., Alfred University, Alfred, N.Y. 

Morrison, H. C, State Superintendent of Schools, Concord, N.H. 

Newton, George A., Trinity University, Waxahachie, Tex. 

Nichols, C. A., Southwestern University, Georgetown, Tex. 

O'Donnell, James A., 95 Boerum St., School 43, Brooklyn, N.Y, 

Olin, A. S., State University, Lawrence, Kan. 

0*Shea, M. V., University of Wisconsin, Madison, Wis. 

Palmer, G. Lloyd, Superintendent of Schools, Frederick, Md. 

Parker, S. Chester, University of Chicago, Chicago, HI. 

Peterson, O. E., Sycamore, HI. 

Phelan, W. W., 629 Boyd St., Norman, Okla. 

Pollack, Rosalie, University of Nevada, Reno, Nev. 

Pusey, E. D., Superintendent of Schools, Durham, N.C. 

Putnam, Helen C, Rhode Island Ave., Providence, R.L 

Rail, E. E., State University, KnoxviQe, Tenn. 
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Rapeer, Louis W., Pennsylvania State College, State College, Pa. 

Reigart, J. F., 31 Euclid Ave., Yonkers, N.Y. 

Rosier, Joseph, Superintendent of Schools, Fairmont, W.Va. 

Roy, Victor L., President, State Normal School, Natchitoches, La. 

Ruediger, W. C, George Washington University, Washington, D.C. 

Russell, James E., Dean of Teachers College, New York City, N.Y. 

R3aiearson, Edward, Principal, Fifth Avenue High School, Pittsburgh, Pa. 

Sachs, Julius, Coliunbia University, New York City, N.Y. 

Scott, Z. E., City Superintendent, Asbury Park, N.J. 

Slauson, Herbert M., Superintendent of Schools, Ann Arbor, Mich. 

Smiley, William H., Superintendent of Schools, Denver, Colo. 

Smith, H. L., Superintendent of Schools, Bloomington, Ind. 

Smoot, Lucy J., 401 1 Baltimore St., Kansas City, Mo. 

Snedden, David S., 302 Ford Bldg., Boston, Mass. 

Snyder, Z. X., President, State Normal School, Greeley, Colo. 

Starch, Daniel, State University, Madison, Wis.^ 

Stark, William E., Supervising Principal of Schools, Hackensack, N.J. 

Stillwell, William E., University School, Cincinnati, Ohio. 

Stockard, L. V., Austin High School, Austin, Tex. 

Stone, Cliff W., Iowa State Teachers College, Cedar Falls, la. 

Stowe, A. Monroe, Toledo University, Toledo, Ohio. 

Strayer, George D., Teachers College, Colimibia University, New York, N.Y. 

Strong, B. Norman, Arsenal School, Hartford, Conn. 

Sutton, W. S., University of Texas, Austin, Tex. 

Suzzallo, Henry, State University, Seattle, Wash. 

Taft, Leanora E., Woodstock, Vt. 

Taylor, Joseph S., 2275 Loring Place, The Bronx, New York, N.Y. 

Thompson, Frank E., University of Colorado, Boulder, Colo. 

Thomdike, Edward L., Teachers College, Columbia University, New York, N.Y. 

Thurber, Charles H., Editor, Ginn & Co., 29 Beacon St., Boston, Mass. 

Updegraff , Harlan, University of Pennsylvania, Philadelphia, Pa. 

Vanderwalker, Nina C, State Normal School, Milwaukee, Wis. 

Van Sickle, James H., Superintendent of Schools, Springfield, Mass. 

Vincent, H. D., Principal, Public School 3, Troy, N.Y. 

Waldo, Dwight B., Western State Normal School, Kalamazoo, Mich. 

Walker, Elmer W., Superintendent, State School for Deaf, Delavan, Wis. 

Weber, S. E., Superintendent of Schools, Scranton, Pa. 

Weglein, David E., Western High School, Baltimore, Md. 

West, Henry S., University of Cincinnati, Cincinnati, Ohio. 

Whipple, G. M., University of Illinois, Urbana, HI. 
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Wiles, Ernest P., Principal, Junior and Senior High School, Evansville, Ind. 

Williams, Henry G., Ohio University, Athens, Ohio. 

Wilson, G. M., Iowa State College, Ames, Iowa. 

Wilson, H. B., Superintendent of Schools, Topeka, Kan. 

Wilson, Mrs. L. L. W., Philadelphia Normal School, Philadelphia, Pa. 

Wright, Robert H., Teachers Training School, Greenville, N.C. 

Zinninger, George Edward, 6i Dewey Ave., Youngstown, Ohio. 



MEMBERSfflP IN THE NATIONAL SOCIETY FOR THE 

STUDY OF EDUCATION 

The purpose of the National Sodety is to promote the investigation 
and discussion of educational questions. Anyone who is interested in 
receiving its publications may become a member. The Yearbooks are 
issued in several Parts each year and are discussed at the annual meeting 
which is held in February at the same time and place as the meeting of 
the Department of Superintendence of the National Education Associa- 
tion. There are two types of membership, associate and active. Asso- 
ciate members pay $i . oo annually and receive one copy of each Yearbook. 
Active members pay $2 . 00 annually, receive two copies of each Yearbook, 
and are eligible to vote and hold office in the Society. 

The Yearbooks deal in a practical way with fundamental current 
issues in instruction and school administration. The Fifteenth Yearbook 
(calendar year 1916) will probably be issued in three parts. Part I will 
contain the " Report of the Committee of the National Council of Educa- 
tion upon Standards and Tests." Part H will treat of "The Rela- 
tionship between Persistence in School and Home Conditions." Part IH 
may be expected to deal with "The Jimior High School Movement." 

New members will be enrolled and sent copies of the current Yearbook, 
as fast as the several parts are published, upon receipt of $2.00 for 
Active or of $1.00 for Associate Membership. Pin your check or 
postal order to the following slip, properly filled out, and mail to the 
Secretary now. 

APPLICATION FOR MEMBERSHIP 

To Guy M. Whipple 

Secretary of the National Society for the Study of Education 
The University of Illinois, Urbana, Illinois 

active 
Please enrol me as an 

associate , 

^ . , r$2 . 00 as payment of active dues for 19 

\$i .00 as payment of associate dues for 19 

Name 



"member 



Address to which 
to mail 
Yearbooks 
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